Sep 06 10:19:46.374694 ip-10-0-137-121 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 06 10:19:46.374707 ip-10-0-137-121 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 06 10:19:46.374716 ip-10-0-137-121 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 06 10:19:46.374978 ip-10-0-137-121 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 06 10:19:56.499533 ip-10-0-137-121 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 06 10:19:56.499553 ip-10-0-137-121 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 7ba85d35a443410aa2b67b9ca6580e41 --
Sep 06 10:21:48.129590 ip-10-0-137-121 systemd[1]: Starting Kubernetes Kubelet...
Sep 06 10:21:48.532484 ip-10-0-137-121 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 10:21:48.532484 ip-10-0-137-121 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 06 10:21:48.532484 ip-10-0-137-121 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 10:21:48.532484 ip-10-0-137-121 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 06 10:21:48.532484 ip-10-0-137-121 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 10:21:48.533546 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.533463    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 06 10:21:48.538421 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538406    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 10:21:48.538421 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538420    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538423    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538427    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538430    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538433    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538436    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538440    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538443    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538446    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538449    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538452    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538455    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538457    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538460    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538463    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538465    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538467    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538470    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538473    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538476    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538479    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 10:21:48.538480 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538482    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 10:21:48.538977 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538485    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 10:21:48.538977 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538488    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 10:21:48.538977 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538491    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 10:21:48.538977 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538494    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 10:21:48.538977 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538497    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 10:21:48.538977 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538500    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 10:21:48.538977 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538502    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 10:21:48.538977 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538505    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 10:21:48.538977 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538507    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 10:21:48.538977 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538510    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 10:21:48.538977 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538513    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 10:21:48.538977 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538517    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 10:21:48.538977 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538522    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 10:21:48.538977 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538525    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 10:21:48.538977 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538528    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 10:21:48.538977 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538531    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 10:21:48.538977 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538534    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 10:21:48.538977 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538537    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 10:21:48.538977 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538540    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 10:21:48.539450 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538542    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 10:21:48.539450 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538545    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 10:21:48.539450 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538548    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 10:21:48.539450 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538550    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 10:21:48.539450 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538553    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 10:21:48.539450 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538555    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 10:21:48.539450 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538558    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 10:21:48.539450 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538561    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 10:21:48.539450 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538563    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 10:21:48.539450 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538565    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 10:21:48.539450 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538568    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 10:21:48.539450 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538570    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 10:21:48.539450 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538573    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 10:21:48.539450 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538575    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 10:21:48.539450 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538579    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 10:21:48.539450 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538582    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 10:21:48.539450 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538585    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 10:21:48.539450 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538587    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 10:21:48.539450 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538591    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 10:21:48.539917 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538593    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 10:21:48.539917 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538596    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 10:21:48.539917 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538598    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 10:21:48.539917 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538602    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 10:21:48.539917 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538606    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 10:21:48.539917 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538608    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 10:21:48.539917 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538611    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 10:21:48.539917 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538614    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 10:21:48.539917 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538616    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 10:21:48.539917 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538619    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 10:21:48.539917 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538622    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 10:21:48.539917 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538624    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 10:21:48.539917 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538627    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 10:21:48.539917 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538629    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 10:21:48.539917 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538632    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 10:21:48.539917 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538634    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 10:21:48.539917 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538637    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 10:21:48.539917 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538639    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 10:21:48.539917 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538642    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 10:21:48.540431 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538644    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 10:21:48.540431 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538647    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 10:21:48.540431 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538651    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 10:21:48.540431 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538654    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 10:21:48.540431 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538656    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 10:21:48.540431 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538659    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 10:21:48.540431 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538661    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 10:21:48.540431 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538663    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 10:21:48.540431 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538667    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 10:21:48.540431 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538671    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 10:21:48.540431 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538674    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 10:21:48.540431 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538678    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 10:21:48.540431 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538681    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 10:21:48.540431 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538684    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 10:21:48.540431 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538687    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 10:21:48.540431 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538690    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 10:21:48.540431 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538693    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 10:21:48.540431 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538696    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 10:21:48.540431 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.538698    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 10:21:48.540894 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539381    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 10:21:48.540894 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539388    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 10:21:48.540894 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539392    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 10:21:48.540894 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539395    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 10:21:48.540894 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539398    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 10:21:48.540894 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539402    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 10:21:48.540894 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539404    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 10:21:48.540894 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539407    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 10:21:48.540894 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539410    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 10:21:48.540894 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539413    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 10:21:48.540894 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539415    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 10:21:48.540894 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539418    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 10:21:48.540894 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539421    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 10:21:48.540894 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539423    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 10:21:48.540894 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539426    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 10:21:48.540894 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539428    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 10:21:48.540894 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539431    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 10:21:48.540894 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539434    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 10:21:48.540894 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539436    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 10:21:48.541386 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539439    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 10:21:48.541386 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539441    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 10:21:48.541386 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539445    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 10:21:48.541386 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539447    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 10:21:48.541386 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539450    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 10:21:48.541386 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539453    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 10:21:48.541386 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539456    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 10:21:48.541386 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539458    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 10:21:48.541386 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539461    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 10:21:48.541386 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539464    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 10:21:48.541386 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539466    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 10:21:48.541386 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539469    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 10:21:48.541386 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539473    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 10:21:48.541386 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539477    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 10:21:48.541386 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539480    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 10:21:48.541386 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539483    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 10:21:48.541386 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539486    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 10:21:48.541386 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539489    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 10:21:48.541386 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539491    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 10:21:48.541386 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539494    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539497    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539500    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539503    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539505    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539507    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539510    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539513    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539515    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539518    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539521    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539523    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539525    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539528    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539532    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539535    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539537    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539540    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539543    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539545    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539548    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 10:21:48.541875 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539550    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 10:21:48.542409 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539553    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 10:21:48.542409 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539555    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 10:21:48.542409 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539558    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 10:21:48.542409 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539560    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 10:21:48.542409 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539564    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 10:21:48.542409 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539567    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 10:21:48.542409 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539570    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 10:21:48.542409 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539573    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 10:21:48.542409 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539575    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 10:21:48.542409 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539578    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 10:21:48.542409 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539580    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 10:21:48.542409 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539583    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 10:21:48.542409 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539585    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 10:21:48.542409 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539588    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 10:21:48.542409 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539591    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 10:21:48.542409 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539593    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 10:21:48.542409 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539598    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 10:21:48.542409 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539600    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 10:21:48.542409 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539603    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 10:21:48.542885 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539605    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 10:21:48.542885 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539608    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 10:21:48.542885 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539610    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 10:21:48.542885 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539612    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 10:21:48.542885 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539615    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 10:21:48.542885 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539618    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 10:21:48.542885 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539621    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 10:21:48.542885 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539624    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 10:21:48.542885 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539627    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 10:21:48.542885 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539629    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 10:21:48.542885 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539632    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 10:21:48.542885 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539635    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 10:21:48.542885 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539637    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 10:21:48.542885 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539639    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 10:21:48.542885 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539643    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 10:21:48.542885 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539646    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 10:21:48.542885 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539649    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 10:21:48.542885 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539652    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 10:21:48.542885 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539655    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 10:21:48.542885 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.539658    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 10:21:48.543383 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540057    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 10:21:48.543383 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540062    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 10:21:48.543383 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540069    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 10:21:48.543383 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540073    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 10:21:48.543383 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540078    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 10:21:48.543383 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540082    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 10:21:48.543383 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540085    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 10:21:48.543383 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540088    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 10:21:48.543383 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540091    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 10:21:48.543383 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540094    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 10:21:48.543383 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540096    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 10:21:48.543383 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540099    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 10:21:48.543383 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540102    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 10:21:48.543383 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540104    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 10:21:48.543383 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540107    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 10:21:48.543383 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540110    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 10:21:48.543383 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540113    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 10:21:48.543383 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540116    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 10:21:48.543383 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540118    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 10:21:48.543843 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540121    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 10:21:48.543843 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540123    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 10:21:48.543843 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540126    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 10:21:48.543843 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540129    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 10:21:48.543843 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540131    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 10:21:48.543843 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540134    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 10:21:48.543843 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540136    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 10:21:48.543843 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540139    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 10:21:48.543843 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540142    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 10:21:48.543843 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540144    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 10:21:48.543843 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540146    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 10:21:48.543843 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540149    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 10:21:48.543843 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540153    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 10:21:48.543843 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540156    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 10:21:48.543843 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540159    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 10:21:48.543843 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540164    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 10:21:48.543843 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540166    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 10:21:48.543843 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540169    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 10:21:48.543843 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540172    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 10:21:48.543843 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540174    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 10:21:48.544351 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540177    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 10:21:48.544351 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540179    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 10:21:48.544351 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540183    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 10:21:48.544351 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540185    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 10:21:48.544351 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540188    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 10:21:48.544351 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540190    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 10:21:48.544351 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540193    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 10:21:48.544351 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540195    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 10:21:48.544351 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540198    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 10:21:48.544351 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540201    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 10:21:48.544351 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540203    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 10:21:48.544351 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540206    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 10:21:48.544351 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540208    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 10:21:48.544351 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540211    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 10:21:48.544351 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540213    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 10:21:48.544351 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540217    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 10:21:48.544351 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540220    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 10:21:48.544351 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540223    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 10:21:48.544351 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540228    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 10:21:48.544805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540230    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 10:21:48.544805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540233    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 10:21:48.544805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540235    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 10:21:48.544805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540238    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 10:21:48.544805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540240    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 10:21:48.544805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540243    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 10:21:48.544805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540245    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 10:21:48.544805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540248    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 10:21:48.544805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540251    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 10:21:48.544805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540254    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 10:21:48.544805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540256    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 10:21:48.544805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540259    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 10:21:48.544805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540262    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 10:21:48.544805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540265    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 10:21:48.544805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540268    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 10:21:48.544805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540270    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 10:21:48.544805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540273    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 10:21:48.544805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540275    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 10:21:48.544805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540279    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 10:21:48.544805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540281    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 10:21:48.545316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540284    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 10:21:48.545316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540286    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 10:21:48.545316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540288    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 10:21:48.545316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540299    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 10:21:48.545316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540302    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 10:21:48.545316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540304    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 10:21:48.545316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540307    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 10:21:48.545316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540310    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 10:21:48.545316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540312    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 10:21:48.545316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540315    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 10:21:48.545316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540331    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 10:21:48.545316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540336    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 10:21:48.545316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540339    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 10:21:48.545316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540341    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 10:21:48.545316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540344    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 10:21:48.545316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540347    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 10:21:48.545316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540349    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 10:21:48.545316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540352    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 10:21:48.545316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540354    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 10:21:48.545316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540357    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.540361    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540430    2561 flags.go:64] FLAG: --address="0.0.0.0"
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540470    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540477    2561 flags.go:64] FLAG: --anonymous-auth="true"
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540481    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540486    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540489    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540493    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540498    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540501    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540504    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540507    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540510    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540514    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540517    2561 flags.go:64] FLAG: --cgroup-root=""
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540519    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540522    2561 flags.go:64] FLAG: --client-ca-file=""
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540525    2561 flags.go:64] FLAG: --cloud-provider="external"
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540528    2561 flags.go:64] FLAG: --cluster-dns="[]"
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540532    2561 flags.go:64] FLAG: --cluster-domain=""
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540535    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540538    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540541    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 06 10:21:48.545815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540545    2561 flags.go:64] FLAG: --container-log-max-files="5"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540549    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540552    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540555    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540558    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540561    2561 flags.go:64] FLAG: --contention-profiling="false"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540564    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540567    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540570    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540574    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540578    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540581    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540584    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540586    2561 flags.go:64] FLAG: --enable-load-reader="false"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540589    2561 flags.go:64] FLAG: --enable-server="true"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540593    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540597    2561 flags.go:64] FLAG: --event-burst="100"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540600    2561 flags.go:64] FLAG: --event-qps="50"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540603    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540606    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540609    2561 flags.go:64] FLAG: --eviction-hard=""
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540613    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540615    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540618    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540621    2561 flags.go:64] FLAG: --eviction-soft=""
Sep 06 10:21:48.546419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540624    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540627    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540630    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540633    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540636    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540639    2561 flags.go:64] FLAG: --fail-swap-on="true"
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540641    2561 flags.go:64] FLAG: --feature-gates=""
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540646    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540649    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540652    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540655    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540658    2561 flags.go:64] FLAG: --healthz-port="10248"
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540660    2561 flags.go:64] FLAG: --help="false"
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540663    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-137-121.ec2.internal"
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540666    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540669    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540674    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540677    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540680    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540683    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540686    2561 flags.go:64] FLAG: --image-service-endpoint=""
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540689    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540692    2561 flags.go:64] FLAG: --kube-api-burst="100"
Sep 06 10:21:48.547026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540695    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540698    2561 flags.go:64] FLAG: --kube-api-qps="50"
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540701    2561 flags.go:64] FLAG: --kube-reserved=""
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540704    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540707    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540710    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540713    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540716    2561 flags.go:64] FLAG: --lock-file=""
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540719    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540722    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540724    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540730    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540733    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540735    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540738    2561 flags.go:64] FLAG: --logging-format="text"
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540741    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540744    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540747    2561 flags.go:64] FLAG: --manifest-url=""
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540750    2561 flags.go:64] FLAG: --manifest-url-header=""
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540754    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540757    2561 flags.go:64] FLAG: --max-open-files="1000000"
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540761    2561 flags.go:64] FLAG: --max-pods="110"
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540764    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540767    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540770    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 06 10:21:48.547625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540774    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540777    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540780    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540783    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540790    2561 flags.go:64] FLAG: --node-status-max-images="50"
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540793    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540796    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540799    2561 flags.go:64] FLAG: --pod-cidr=""
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540802    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540808    2561 flags.go:64] FLAG: --pod-manifest-path=""
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540811    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540814    2561 flags.go:64] FLAG: --pods-per-core="0"
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540817    2561 flags.go:64] FLAG: --port="10250"
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540820    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540823    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a3af4b42c04da3c8"
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540826    2561 flags.go:64] FLAG: --qos-reserved=""
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540829    2561 flags.go:64] FLAG: --read-only-port="10255"
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540832    2561 flags.go:64] FLAG: --register-node="true"
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540835    2561 flags.go:64] FLAG: --register-with-taints=""
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540838    2561 flags.go:64] FLAG: --registry-burst="10"
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540841    2561 flags.go:64] FLAG: --registry-qps="5"
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540844    2561 flags.go:64] FLAG: --reserved-cpus=""
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540847    2561 flags.go:64] FLAG: --reserved-memory=""
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540850    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540853    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 06 10:21:48.548236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540856    2561 flags.go:64] FLAG: --rotate-certificates="false"
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540859    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540862    2561 flags.go:64] FLAG: --runonce="false"
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540865    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540868    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540870    2561 flags.go:64] FLAG: --seccomp-default="false"
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540873    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540876    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540880    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540883    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540886    2561 flags.go:64] FLAG: --storage-driver-password="root"
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540889    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540892    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540894    2561 flags.go:64] FLAG: --storage-driver-user="root"
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540897    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540900    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540906    2561 flags.go:64] FLAG: --system-cgroups=""
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540909    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540914    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540917    2561 flags.go:64] FLAG: --tls-cert-file=""
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540923    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540927    2561 flags.go:64] FLAG: --tls-min-version=""
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540930    2561 flags.go:64] FLAG: --tls-private-key-file=""
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540932    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540935    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 06 10:21:48.549013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540938    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540941    2561 flags.go:64] FLAG: --v="2"
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540944    2561 flags.go:64] FLAG: --version="false"
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540948    2561 flags.go:64] FLAG: --vmodule=""
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540951    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.540955    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541070    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541074    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541077    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541080    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541083    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541086    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541089    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541093    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541096    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541100    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541103    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541106    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541109    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541112    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541114    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 10:21:48.549639 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541117    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 10:21:48.550139 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541119    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 10:21:48.550139 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541123    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 10:21:48.550139 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541128    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 10:21:48.550139 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541131    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 10:21:48.550139 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541135    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 10:21:48.550139 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541140    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 10:21:48.550139 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541143    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 10:21:48.550139 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541146    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 10:21:48.550139 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541149    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 10:21:48.550139 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541151    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 10:21:48.550139 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541154    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 10:21:48.550139 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541157    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 10:21:48.550139 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541160    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 10:21:48.550139 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541163    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 10:21:48.550139 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541165    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 10:21:48.550139 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541168    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 10:21:48.550139 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541170    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 10:21:48.550139 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541173    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 10:21:48.550139 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541175    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 10:21:48.550621 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541178    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 10:21:48.550621 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541180    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 10:21:48.550621 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541182    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 10:21:48.550621 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541185    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 10:21:48.550621 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541187    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 10:21:48.550621 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541190    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 10:21:48.550621 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541193    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 10:21:48.550621 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541196    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 10:21:48.550621 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541199    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 10:21:48.550621 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541201    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 10:21:48.550621 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541204    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 10:21:48.550621 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541206    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 10:21:48.550621 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541209    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 10:21:48.550621 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541212    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 10:21:48.550621 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541215    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 10:21:48.550621 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541217    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 10:21:48.550621 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541220    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 10:21:48.550621 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541223    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 10:21:48.550621 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541226    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 10:21:48.551087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541229    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 10:21:48.551087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541232    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 10:21:48.551087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541234    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 10:21:48.551087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541237    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 10:21:48.551087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541239    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 10:21:48.551087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541241    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 10:21:48.551087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541244    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 10:21:48.551087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541246    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 10:21:48.551087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541249    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 10:21:48.551087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541252    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 10:21:48.551087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541254    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 10:21:48.551087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541257    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 10:21:48.551087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541259    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 10:21:48.551087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541261    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 10:21:48.551087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541264    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 10:21:48.551087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541267    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 10:21:48.551087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541269    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 10:21:48.551087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541272    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 10:21:48.551087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541274    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 10:21:48.551087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541278    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 10:21:48.551783 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541281    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 10:21:48.551783 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541283    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 10:21:48.551783 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541286    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 10:21:48.551783 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541288    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 10:21:48.551783 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541291    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 10:21:48.551783 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541294    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 10:21:48.551783 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541296    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 10:21:48.551783 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541299    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 10:21:48.551783 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541301    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 10:21:48.551783 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541304    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 10:21:48.551783 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541307    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 10:21:48.551783 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541310    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 10:21:48.551783 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541313    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 10:21:48.551783 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541316    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 10:21:48.551783 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541332    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 10:21:48.551783 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541337    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 10:21:48.551783 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541341    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 10:21:48.551783 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541345    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 10:21:48.551783 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541349    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 10:21:48.551783 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541352    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 10:21:48.552619 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541355    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 10:21:48.552619 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541358    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 10:21:48.552619 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541361    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 10:21:48.552619 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541363    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 10:21:48.552619 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.541366    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 10:21:48.552619 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.542107    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 10:21:48.552619 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.549717    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 06 10:21:48.552619 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.549732    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 06 10:21:48.552619 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.549745    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 06 10:21:48.552619 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.549755    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 06 10:21:48.552619 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549809    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 10:21:48.552619 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549814    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 10:21:48.552619 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549817    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 10:21:48.552619 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549820    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 10:21:48.552619 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549823    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 10:21:48.553119 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549826    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 10:21:48.553119 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549829    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 10:21:48.553119 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549832    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 10:21:48.553119 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549835    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 10:21:48.553119 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549838    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 10:21:48.553119 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549840    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 10:21:48.553119 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549843    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 10:21:48.553119 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549846    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 10:21:48.553119 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549848    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 10:21:48.553119 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549851    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 10:21:48.553119 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549854    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 10:21:48.553119 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549856    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 10:21:48.553119 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549859    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 10:21:48.553119 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549862    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 10:21:48.553119 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549864    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 10:21:48.553119 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549867    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 10:21:48.553119 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549869    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 10:21:48.553119 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549872    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 10:21:48.553119 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549875    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 10:21:48.553707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549877    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 10:21:48.553707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549880    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 10:21:48.553707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549882    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 10:21:48.553707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549885    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 10:21:48.553707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549887    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 10:21:48.553707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549891    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 10:21:48.553707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549894    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 10:21:48.553707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549896    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 10:21:48.553707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549899    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 10:21:48.553707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549902    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 10:21:48.553707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549904    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 10:21:48.553707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549907    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 10:21:48.553707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549909    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 10:21:48.553707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549912    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 10:21:48.553707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549915    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 10:21:48.553707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549917    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 10:21:48.553707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549920    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 10:21:48.553707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549922    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 10:21:48.553707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549925    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 10:21:48.553707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549928    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 10:21:48.554202 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549930    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 10:21:48.554202 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549934    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 10:21:48.554202 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549938    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 10:21:48.554202 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549941    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 10:21:48.554202 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549944    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 10:21:48.554202 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549946    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 10:21:48.554202 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549948    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 10:21:48.554202 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549951    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 10:21:48.554202 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549953    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 10:21:48.554202 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549956    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 10:21:48.554202 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549958    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 10:21:48.554202 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549961    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 10:21:48.554202 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549964    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 10:21:48.554202 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549966    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 10:21:48.554202 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549969    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 10:21:48.554202 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549971    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 10:21:48.554202 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549974    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 10:21:48.554202 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549978    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 10:21:48.554202 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549981    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 10:21:48.554686 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549983    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 10:21:48.554686 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549986    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 10:21:48.554686 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549989    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 10:21:48.554686 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549991    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 10:21:48.554686 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549993    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 10:21:48.554686 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549996    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 10:21:48.554686 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.549998    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 10:21:48.554686 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550001    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 10:21:48.554686 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550003    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 10:21:48.554686 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550006    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 10:21:48.554686 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550008    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 10:21:48.554686 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550011    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 10:21:48.554686 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550014    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 10:21:48.554686 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550017    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 10:21:48.554686 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550019    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 10:21:48.554686 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550021    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 10:21:48.554686 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550024    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 10:21:48.554686 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550027    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 10:21:48.554686 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550029    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 10:21:48.554686 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550032    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 10:21:48.555164 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550034    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 10:21:48.555164 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550036    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 10:21:48.555164 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550039    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 10:21:48.555164 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550042    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 10:21:48.555164 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550044    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 10:21:48.555164 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550047    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 10:21:48.555164 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550049    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 10:21:48.555164 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550052    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 10:21:48.555164 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550055    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 10:21:48.555164 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550057    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 10:21:48.555164 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550060    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 10:21:48.555164 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550063    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 10:21:48.555164 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550067    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 10:21:48.555164 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550071    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 10:21:48.555164 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550074    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 10:21:48.555164 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550079    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 10:21:48.555568 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.550084    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 10:21:48.555568 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550195    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 10:21:48.555568 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550199    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 10:21:48.555568 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550202    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 10:21:48.555568 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550205    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 10:21:48.555568 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550208    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 10:21:48.555568 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550211    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 10:21:48.555568 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550213    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 10:21:48.555568 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550216    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 10:21:48.555568 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550218    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 10:21:48.555568 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550221    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 10:21:48.555568 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550223    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 10:21:48.555568 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550226    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 10:21:48.555568 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550228    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 10:21:48.555912 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550231    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 10:21:48.555912 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550234    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 10:21:48.555912 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550236    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 10:21:48.555912 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550239    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 10:21:48.555912 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550241    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 10:21:48.555912 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550244    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 10:21:48.555912 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550246    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 10:21:48.555912 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550249    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 10:21:48.555912 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550251    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 10:21:48.555912 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550254    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 10:21:48.555912 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550256    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 10:21:48.555912 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550259    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 10:21:48.555912 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550261    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 10:21:48.555912 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550265    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 10:21:48.555912 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550268    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 10:21:48.555912 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550271    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 10:21:48.555912 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550274    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 10:21:48.555912 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550276    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 10:21:48.555912 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550279    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 10:21:48.555912 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550281    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 10:21:48.556424 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550283    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 10:21:48.556424 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550286    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 10:21:48.556424 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550289    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 10:21:48.556424 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550291    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 10:21:48.556424 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550294    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 10:21:48.556424 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550296    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 10:21:48.556424 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550299    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 10:21:48.556424 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550301    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 10:21:48.556424 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550304    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 10:21:48.556424 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550306    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 10:21:48.556424 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550309    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 10:21:48.556424 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550311    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 10:21:48.556424 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550315    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 10:21:48.556424 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550333    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 10:21:48.556424 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550336    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 10:21:48.556424 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550339    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 10:21:48.556424 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550342    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 10:21:48.556424 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550345    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 10:21:48.556424 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550347    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 10:21:48.556424 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550350    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 10:21:48.556896 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550353    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 10:21:48.556896 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550356    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 10:21:48.556896 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550358    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 10:21:48.556896 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550361    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 10:21:48.556896 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550363    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 10:21:48.556896 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550367    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 10:21:48.556896 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550369    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 10:21:48.556896 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550372    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 10:21:48.556896 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550375    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 10:21:48.556896 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550378    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 10:21:48.556896 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550380    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 10:21:48.556896 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550383    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 10:21:48.556896 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550387    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 10:21:48.556896 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550390    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 10:21:48.556896 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550393    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 10:21:48.556896 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550395    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 10:21:48.556896 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550398    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 10:21:48.556896 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550400    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 10:21:48.556896 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550403    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 10:21:48.556896 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550405    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 10:21:48.557414 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550408    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 10:21:48.557414 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550410    2561 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 10:21:48.557414 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550413    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 10:21:48.557414 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550415    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 10:21:48.557414 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550418    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 10:21:48.557414 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550422    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 10:21:48.557414 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550425    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 10:21:48.557414 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550428    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 10:21:48.557414 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550431    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 10:21:48.557414 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550434    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 10:21:48.557414 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550436    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 10:21:48.557414 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550439    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 10:21:48.557414 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550442    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 10:21:48.557414 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550444    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 10:21:48.557414 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550447    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 10:21:48.557414 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550450    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 10:21:48.557414 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550453    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 10:21:48.557414 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550455    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 10:21:48.557414 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550458    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 10:21:48.557881 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550460    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 10:21:48.557881 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550463    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 10:21:48.557881 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550466    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 10:21:48.557881 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550468    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 10:21:48.557881 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550471    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 10:21:48.557881 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550473    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 10:21:48.557881 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:48.550476    2561 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 10:21:48.557881 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.550481    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 10:21:48.557881 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.550576    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 06 10:21:48.557881 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.556043    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 06 10:21:48.558141 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.558126    2561 server.go:1019] "Starting client certificate rotation"
Sep 06 10:21:48.558251 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.558231    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 06 10:21:48.558342 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.558315    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 06 10:21:48.561048 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.561033    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 06 10:21:48.564174 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.564153    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 06 10:21:48.573445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.573430    2561 log.go:25] "Validated CRI v1 runtime API"
Sep 06 10:21:48.578959 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.578944    2561 log.go:25] "Validated CRI v1 image API"
Sep 06 10:21:48.580882 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.580858    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 06 10:21:48.584175 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.584148    2561 fs.go:135] Filesystem UUIDs: map[4267a99d-0a8d-4728-8008-01cf3a6d17e0:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e819198d-6c2e-4966-8160-f16715a63ffd:/dev/nvme0n1p4]
Sep 06 10:21:48.584260 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.584174    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 06 10:21:48.588343 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.588209    2561 manager.go:216] Machine: {Timestamp:2026-09-06 10:21:48.587754657 +0000 UTC m=+0.366174061 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099710 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b4997ce7d0134b541d02650b0347b SystemUUID:ec2b4997-ce7d-0134-b541-d02650b0347b BootID:7ba85d35-a443-410a-a2b6-7b9ca6580e41 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e2:1a:e6:16:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e2:1a:e6:16:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:74:99:8e:93:01 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 06 10:21:48.588343 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.588317    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 06 10:21:48.588555 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.588475    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 06 10:21:48.590121 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.590107    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 06 10:21:48.592351 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.592316    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 06 10:21:48.592480 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.592356    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-121.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 06 10:21:48.593144 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.593135    2561 topology_manager.go:138] "Creating topology manager with none policy"
Sep 06 10:21:48.593174 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.593146    2561 container_manager_linux.go:309] "Creating device plugin manager"
Sep 06 10:21:48.593174 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.593154    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 06 10:21:48.593836 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.593825    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 06 10:21:48.595094 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.595085    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 06 10:21:48.599349 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.599337    2561 state_mem.go:36] "Initialized new in-memory state store"
Sep 06 10:21:48.599453 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.599444    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 06 10:21:48.599481 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.599472    2561 kubelet.go:486] "Attempting to sync node with API server"
Sep 06 10:21:48.599702 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.599691    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 06 10:21:48.599744 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.599716    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 06 10:21:48.599744 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.599744    2561 kubelet.go:398] "Adding apiserver pod source"
Sep 06 10:21:48.599895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.599870    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 06 10:21:48.600474 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.600458    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 06 10:21:48.600552 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.600484    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 06 10:21:48.603196 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.603178    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 06 10:21:48.606223 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.606208    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 06 10:21:48.606294 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.606238    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 06 10:21:48.607565 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.607552    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 06 10:21:48.607610 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.607572    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 06 10:21:48.607610 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.607578    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 06 10:21:48.607610 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.607584    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 06 10:21:48.607610 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.607597    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 06 10:21:48.607610 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.607606    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 06 10:21:48.607745 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.607621    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 06 10:21:48.607745 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.607627    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 06 10:21:48.607745 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.607634    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 06 10:21:48.607745 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.607640    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 06 10:21:48.607745 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.607649    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 06 10:21:48.607745 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.607654    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 06 10:21:48.607745 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.607678    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 06 10:21:48.607745 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.607684    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 06 10:21:48.608933 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.608908    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 06 10:21:48.609029 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.608954    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 06 10:21:48.611653 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.611638    2561 server.go:1268] "Started kubelet"
Sep 06 10:21:48.611726 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.611684    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-121.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 06 10:21:48.611726 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.611697    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 06 10:21:48.612407 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.612358    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 06 10:21:48.612486 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.612433    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 06 10:21:48.612442 ip-10-0-137-121 systemd[1]: Started Kubernetes Kubelet.
Sep 06 10:21:48.613761 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.613741    2561 server.go:310] "Adding debug handlers to kubelet server"
Sep 06 10:21:48.615076 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.614006    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 06 10:21:48.617414 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.617393    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 06 10:21:48.619456 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.618297    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-121.ec2.internal.18d2b42d490cdc2f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-121.ec2.internal,UID:ip-10-0-137-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-121.ec2.internal,},FirstTimestamp:2026-09-06 10:21:48.611615791 +0000 UTC m=+0.390035195,LastTimestamp:2026-09-06 10:21:48.611615791 +0000 UTC m=+0.390035195,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-121.ec2.internal,}"
Sep 06 10:21:48.620799 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.620782    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 06 10:21:48.621571 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.621556    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 06 10:21:48.621670 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.621646    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found"
Sep 06 10:21:48.622239 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.622220    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 06 10:21:48.622239 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.622241    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 06 10:21:48.622387 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.622227    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 06 10:21:48.622432 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.622387    2561 reconstruct.go:97] "Volume reconstruction finished"
Sep 06 10:21:48.622432 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.622395    2561 reconciler.go:29] "Reconciler: start to sync state"
Sep 06 10:21:48.622523 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.622449    2561 factory.go:55] Registering systemd factory
Sep 06 10:21:48.622523 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.622466    2561 factory.go:223] Registration of the systemd container factory successfully
Sep 06 10:21:48.622657 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.622645    2561 factory.go:153] Registering CRI-O factory
Sep 06 10:21:48.622709 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.622660    2561 factory.go:223] Registration of the crio container factory successfully
Sep 06 10:21:48.622709 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.622701    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 06 10:21:48.622799 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.622762    2561 factory.go:103] Registering Raw factory
Sep 06 10:21:48.622799 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.622775    2561 manager.go:1196] Started watching for new ooms in manager
Sep 06 10:21:48.623507 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.623493    2561 manager.go:349] Starting recovery of all containers
Sep 06 10:21:48.627228 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.627205    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 06 10:21:48.627309 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.627268    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 06 10:21:48.637508 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.637492    2561 manager.go:354] Recovery completed
Sep 06 10:21:48.639883 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.639860    2561 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 06 10:21:48.642729 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.642716    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 10:21:48.644924 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.644908    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 10:21:48.644994 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.644938    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 10:21:48.644994 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.644949    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID"
Sep 06 10:21:48.645532 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.645518    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 06 10:21:48.645532 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.645530    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 10:21:48.645657 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.645532    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 06 10:21:48.645657 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.645561    2561 state_mem.go:36] "Initialized new in-memory state store"
Sep 06 10:21:48.646282 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.646267    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 10:21:48.646440 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.646296    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 10:21:48.646440 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.646312    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID"
Sep 06 10:21:48.646802 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.646720    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-121.ec2.internal.18d2b42d4b0919f6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-121.ec2.internal,UID:ip-10-0-137-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-121.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-121.ec2.internal,},FirstTimestamp:2026-09-06 10:21:48.644923894 +0000 UTC m=+0.423343298,LastTimestamp:2026-09-06 10:21:48.644923894 +0000 UTC m=+0.423343298,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-121.ec2.internal,}"
Sep 06 10:21:48.647543 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.647525    2561 policy_none.go:49] "None policy: Start"
Sep 06 10:21:48.647543 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.647544    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 06 10:21:48.647645 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.647557    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 06 10:21:48.649461 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.649368    2561 policy_none.go:47] "Start"
Sep 06 10:21:48.654875 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.654783    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-121.ec2.internal.18d2b42d4b096768  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-121.ec2.internal,UID:ip-10-0-137-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-121.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-121.ec2.internal,},FirstTimestamp:2026-09-06 10:21:48.64494372 +0000 UTC m=+0.423363124,LastTimestamp:2026-09-06 10:21:48.64494372 +0000 UTC m=+0.423363124,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-121.ec2.internal,}"
Sep 06 10:21:48.659530 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.659510    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qj7sp"
Sep 06 10:21:48.663548 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.663482    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-121.ec2.internal.18d2b42d4b098e03  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-121.ec2.internal,UID:ip-10-0-137-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-121.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-121.ec2.internal,},FirstTimestamp:2026-09-06 10:21:48.644953603 +0000 UTC m=+0.423373007,LastTimestamp:2026-09-06 10:21:48.644953603 +0000 UTC m=+0.423373007,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-121.ec2.internal,}"
Sep 06 10:21:48.670245 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.670229    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-qj7sp"
Sep 06 10:21:48.674744 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.674680    2561 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-121.ec2.internal.18d2b42d4b0919f6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-121.ec2.internal.18d2b42d4b0919f6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-121.ec2.internal,UID:ip-10-0-137-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-121.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-121.ec2.internal,},FirstTimestamp:2026-09-06 10:21:48.644923894 +0000 UTC m=+0.423343298,LastTimestamp:2026-09-06 10:21:48.646281366 +0000 UTC m=+0.424700776,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-121.ec2.internal,}"
Sep 06 10:21:48.700743 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.680979    2561 manager.go:337] "Starting Device Plugin manager"
Sep 06 10:21:48.700743 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.681027    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 06 10:21:48.700743 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.681039    2561 server.go:87] "Starting device plugin registration server"
Sep 06 10:21:48.700743 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.681284    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 06 10:21:48.700743 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.681295    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 06 10:21:48.700743 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.681379    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 06 10:21:48.700743 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.681466    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 06 10:21:48.700743 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.681476    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 06 10:21:48.700743 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.683243    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 06 10:21:48.700743 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.683284    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-121.ec2.internal\" not found"
Sep 06 10:21:48.746106 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.746066    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 06 10:21:48.747274 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.747253    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 06 10:21:48.747405 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.747305    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 06 10:21:48.747405 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.747344    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 06 10:21:48.747540 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.747444    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 06 10:21:48.749970 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.749947    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 10:21:48.781980 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.781960    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 10:21:48.783159 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.783083    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 10:21:48.783159 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.783109    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 10:21:48.783159 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.783125    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID"
Sep 06 10:21:48.783159 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.783148    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-121.ec2.internal"
Sep 06 10:21:48.791026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.791011    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-121.ec2.internal"
Sep 06 10:21:48.791090 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.791032    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-121.ec2.internal\": node \"ip-10-0-137-121.ec2.internal\" not found"
Sep 06 10:21:48.809922 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.809904    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found"
Sep 06 10:21:48.847998 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.847974    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal"]
Sep 06 10:21:48.848102 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.848049    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 10:21:48.849501 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.849485    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 10:21:48.849588 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.849515    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 10:21:48.849588 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.849530    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID"
Sep 06 10:21:48.851924 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.851911    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 10:21:48.852041 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.852028    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal"
Sep 06 10:21:48.852079 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.852056    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 10:21:48.852674 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.852659    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 10:21:48.852674 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.852666    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 10:21:48.852791 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.852683    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 10:21:48.852791 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.852689    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 10:21:48.852791 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.852694    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID"
Sep 06 10:21:48.852791 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.852698    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID"
Sep 06 10:21:48.855009 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.854993    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal"
Sep 06 10:21:48.855089 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.855020    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 10:21:48.855742 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.855727    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 10:21:48.855830 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.855750    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 10:21:48.855830 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.855760    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID"
Sep 06 10:21:48.881838 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.881821    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-121.ec2.internal\" not found" node="ip-10-0-137-121.ec2.internal"
Sep 06 10:21:48.885946 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.885931    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-121.ec2.internal\" not found" node="ip-10-0-137-121.ec2.internal"
Sep 06 10:21:48.910102 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:48.910083    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found"
Sep 06 10:21:48.924796 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.924781    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/883f5516537eee85b2309f7c3e4b7df0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal\" (UID: \"883f5516537eee85b2309f7c3e4b7df0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal"
Sep 06 10:21:48.924868 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.924807    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/883f5516537eee85b2309f7c3e4b7df0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal\" (UID: \"883f5516537eee85b2309f7c3e4b7df0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal"
Sep 06 10:21:48.924868 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:48.924823    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9dd0ee06e29e903dab72058d7f78cdf8-config\") pod \"kube-apiserver-proxy-ip-10-0-137-121.ec2.internal\" (UID: \"9dd0ee06e29e903dab72058d7f78cdf8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal"
Sep 06 10:21:49.010660 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:49.010636    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found"
Sep 06 10:21:49.024940 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.024912    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/883f5516537eee85b2309f7c3e4b7df0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal\" (UID: \"883f5516537eee85b2309f7c3e4b7df0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal"
Sep 06 10:21:49.024940 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.024945    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/883f5516537eee85b2309f7c3e4b7df0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal\" (UID: \"883f5516537eee85b2309f7c3e4b7df0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal"
Sep 06 10:21:49.025046 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.024965    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9dd0ee06e29e903dab72058d7f78cdf8-config\") pod \"kube-apiserver-proxy-ip-10-0-137-121.ec2.internal\" (UID: \"9dd0ee06e29e903dab72058d7f78cdf8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal"
Sep 06 10:21:49.025046 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.025004    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/883f5516537eee85b2309f7c3e4b7df0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal\" (UID: \"883f5516537eee85b2309f7c3e4b7df0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal"
Sep 06 10:21:49.025046 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.025018    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/883f5516537eee85b2309f7c3e4b7df0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal\" (UID: \"883f5516537eee85b2309f7c3e4b7df0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal"
Sep 06 10:21:49.025046 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.025041    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9dd0ee06e29e903dab72058d7f78cdf8-config\") pod \"kube-apiserver-proxy-ip-10-0-137-121.ec2.internal\" (UID: \"9dd0ee06e29e903dab72058d7f78cdf8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal"
Sep 06 10:21:49.111419 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:49.111358    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found"
Sep 06 10:21:49.183794 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.183763    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal"
Sep 06 10:21:49.189024 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.189000    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal"
Sep 06 10:21:49.211656 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:49.211627    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found"
Sep 06 10:21:49.312147 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:49.312123    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found"
Sep 06 10:21:49.414587 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:49.414546    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found"
Sep 06 10:21:49.520983 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:49.520946    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found"
Sep 06 10:21:49.544948 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.544922    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 10:21:49.557474 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.557450    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 06 10:21:49.557598 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.557579    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 06 10:21:49.557655 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.557627    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 06 10:21:49.601147 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.601121    2561 apiserver.go:52] "Watching apiserver"
Sep 06 10:21:49.620549 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.620489    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 06 10:21:49.621370 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.621354    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 06 10:21:49.621845 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.621819    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal"
Sep 06 10:21:49.622494 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.622468    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-fnht9","openshift-cluster-node-tuning-operator/tuned-q2c9s","openshift-multus/multus-5pbf6","openshift-multus/network-metrics-daemon-6prgq","openshift-network-diagnostics/network-check-target-gdhpd","openshift-network-operator/iptables-alerter-gqm8p","kube-system/global-pull-secret-syncer-nkc66","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6","openshift-dns/node-resolver-mtfnz","openshift-image-registry/node-ca-zr4w8","openshift-multus/multus-additional-cni-plugins-h6wfp","openshift-ovn-kubernetes/ovnkube-node-bsw6t"]
Sep 06 10:21:49.625857 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.625837    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fnht9"
Sep 06 10:21:49.628488 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.628471    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.628586 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.628490    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hlscz\""
Sep 06 10:21:49.628890 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.628873    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 06 10:21:49.629082 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.629069    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 06 10:21:49.630964 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.630944    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 06 10:21:49.631042 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.630999    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 06 10:21:49.631042 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.631023    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6s98h\""
Sep 06 10:21:49.631378 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.631359    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.633046 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.633029    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 06 10:21:49.633533 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.633516    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 06 10:21:49.633620 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.633598    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 06 10:21:49.633835 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.633819    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tqvx9\""
Sep 06 10:21:49.633886 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.633843    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 06 10:21:49.633930 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.633880    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 06 10:21:49.634257 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.634242    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:21:49.634321 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:49.634305    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6prgq" podUID="705da257-7931-44ef-89b4-070ba34f4cb0"
Sep 06 10:21:49.637219 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.637203    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:21:49.637274 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:49.637259    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhpd" podUID="77c1dc1a-0efd-4422-842c-c630206d37a0"
Sep 06 10:21:49.638445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.638430    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 06 10:21:49.638503 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.638493    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal"
Sep 06 10:21:49.640164 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.640146    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gqm8p"
Sep 06 10:21:49.642487 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.642468    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 06 10:21:49.642570 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.642483    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 06 10:21:49.642570 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.642510    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 06 10:21:49.642570 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.642478    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jpqk9\""
Sep 06 10:21:49.642985 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.642970    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:21:49.643044 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:49.643024    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkc66" podUID="4ff152b4-4c19-4c64-af60-41eeb9cbb81e"
Sep 06 10:21:49.645981 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.645961    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.647898 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.647876    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 06 10:21:49.649184 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.649167    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2p28f\""
Sep 06 10:21:49.649422 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.649408    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 06 10:21:49.649510 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.649499    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 06 10:21:49.650028 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.650010    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mtfnz"
Sep 06 10:21:49.650488 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.650473    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 06 10:21:49.652373 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.652354    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 06 10:21:49.652614 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.652597    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 06 10:21:49.652728 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.652714    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kwpll\""
Sep 06 10:21:49.655655 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.655615    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zr4w8"
Sep 06 10:21:49.658074 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.658057    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 06 10:21:49.658287 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.658271    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 06 10:21:49.658369 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.658332    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 06 10:21:49.658460 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.658372    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s5krt\""
Sep 06 10:21:49.659553 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.659535    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.659673 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.659659    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7h7s5"
Sep 06 10:21:49.661573 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.661558    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 06 10:21:49.661765 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.661741    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 06 10:21:49.661875 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.661783    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xtxfl\""
Sep 06 10:21:49.662359 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.662341    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal"]
Sep 06 10:21:49.662460 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.662376    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal"]
Sep 06 10:21:49.662460 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.662405    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.664852 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.664831    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 06 10:21:49.664852 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.664842    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 06 10:21:49.665152 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.665139    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 06 10:21:49.665209 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.665195    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 06 10:21:49.665283 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.665265    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 06 10:21:49.665390 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.665286    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 06 10:21:49.665444 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.665390    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fmthv\""
Sep 06 10:21:49.668766 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.668737    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7h7s5"
Sep 06 10:21:49.677548 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.677507    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-05 10:16:49 +0000 UTC" deadline="2028-03-18 20:39:04.466470157 +0000 UTC"
Sep 06 10:21:49.677548 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.677546    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13426h17m14.7889262s"
Sep 06 10:21:49.694605 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.694577    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 10:21:49.723544 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.723522    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 06 10:21:49.729196 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729174    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-host-var-lib-cni-multus\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.729290 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729204    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwjgx\" (UniqueName: \"kubernetes.io/projected/3e728c52-da89-4425-b478-c21e3eea361a-kube-api-access-pwjgx\") pod \"node-resolver-mtfnz\" (UID: \"3e728c52-da89-4425-b478-c21e3eea361a\") " pod="openshift-dns/node-resolver-mtfnz"
Sep 06 10:21:49.729290 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729232    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41e422ba-4ef6-44da-8f45-a57714ce78b8-iptables-alerter-script\") pod \"iptables-alerter-gqm8p\" (UID: \"41e422ba-4ef6-44da-8f45-a57714ce78b8\") " pod="openshift-network-operator/iptables-alerter-gqm8p"
Sep 06 10:21:49.729290 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729250    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-dbus\") pod \"global-pull-secret-syncer-nkc66\" (UID: \"4ff152b4-4c19-4c64-af60-41eeb9cbb81e\") " pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:21:49.729290 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729275    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-kubelet\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.729459 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729302    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-slash\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.729459 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729318    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-var-lib-openvswitch\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.729459 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729332    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-hostroot\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.729459 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729410    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret\") pod \"global-pull-secret-syncer-nkc66\" (UID: \"4ff152b4-4c19-4c64-af60-41eeb9cbb81e\") " pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:21:49.729459 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729437    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-etc-sysctl-d\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.729459 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729455    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4268319-f028-4865-857a-4b453a4c42fd-konnectivity-ca\") pod \"konnectivity-agent-fnht9\" (UID: \"f4268319-f028-4865-857a-4b453a4c42fd\") " pod="kube-system/konnectivity-agent-fnht9"
Sep 06 10:21:49.729699 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729470    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-run-netns\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.729699 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729485    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-run-systemd\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.729699 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729509    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-etc-systemd\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.729699 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729553    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-multus-cni-dir\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.729699 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729604    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1fec0b65-b25f-4f26-9dd5-facb730de5a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.729699 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729636    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4268319-f028-4865-857a-4b453a4c42fd-agent-certs\") pod \"konnectivity-agent-fnht9\" (UID: \"f4268319-f028-4865-857a-4b453a4c42fd\") " pod="kube-system/konnectivity-agent-fnht9"
Sep 06 10:21:49.729699 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729660    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58f272b6-b27a-4514-b8a9-a77b936c8cd2-socket-dir\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.729969 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729703    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-cni-bin\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.729969 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729727    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.729969 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729778    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-var-lib-kubelet\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.729969 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729809    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1fec0b65-b25f-4f26-9dd5-facb730de5a8-cnibin\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.729969 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729835    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-cni-netd\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.729969 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729858    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-system-cni-dir\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.729969 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729879    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-host-run-multus-certs\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.729969 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729898    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4e601580-f2cf-423c-bf46-337104486a51-serviceca\") pod \"node-ca-zr4w8\" (UID: \"4e601580-f2cf-423c-bf46-337104486a51\") " pod="openshift-image-registry/node-ca-zr4w8"
Sep 06 10:21:49.729969 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729920    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58f272b6-b27a-4514-b8a9-a77b936c8cd2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.729969 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729943    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flpw7\" (UniqueName: \"kubernetes.io/projected/a4733769-37b3-443b-9ee5-d93bd5f167f0-kube-api-access-flpw7\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.730281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.729987    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-etc-kubernetes\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.730281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730012    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-host\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.730281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730033    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6463314-419e-4775-b0b7-848374626327-etc-tuned\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.730281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730068    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6463314-419e-4775-b0b7-848374626327-tmp\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.730281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730094    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwljr\" (UniqueName: \"kubernetes.io/projected/1fec0b65-b25f-4f26-9dd5-facb730de5a8-kube-api-access-bwljr\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.730281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730113    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2s2l\" (UniqueName: \"kubernetes.io/projected/41e422ba-4ef6-44da-8f45-a57714ce78b8-kube-api-access-b2s2l\") pod \"iptables-alerter-gqm8p\" (UID: \"41e422ba-4ef6-44da-8f45-a57714ce78b8\") " pod="openshift-network-operator/iptables-alerter-gqm8p"
Sep 06 10:21:49.730281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730151    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-kubelet-config\") pod \"global-pull-secret-syncer-nkc66\" (UID: \"4ff152b4-4c19-4c64-af60-41eeb9cbb81e\") " pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:21:49.730281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730173    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-etc-openvswitch\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.730281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730189    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-sys\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.730281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730204    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh2sv\" (UniqueName: \"kubernetes.io/projected/e0afff6f-56fa-47c8-81ed-e519bde388ba-kube-api-access-qh2sv\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.730281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730227    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1fec0b65-b25f-4f26-9dd5-facb730de5a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.730281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730265    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-systemd-units\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.730281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730281    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-run-openvswitch\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.730907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730308    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-run-ovn\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.730907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730323    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-etc-modprobe-d\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.730907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730354    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0afff6f-56fa-47c8-81ed-e519bde388ba-cni-binary-copy\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.730907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730372    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbwxc\" (UniqueName: \"kubernetes.io/projected/4e601580-f2cf-423c-bf46-337104486a51-kube-api-access-fbwxc\") pod \"node-ca-zr4w8\" (UID: \"4e601580-f2cf-423c-bf46-337104486a51\") " pod="openshift-image-registry/node-ca-zr4w8"
Sep 06 10:21:49.730907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730387    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1fec0b65-b25f-4f26-9dd5-facb730de5a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.730907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730402    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58f272b6-b27a-4514-b8a9-a77b936c8cd2-registration-dir\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.730907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730439    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58f272b6-b27a-4514-b8a9-a77b936c8cd2-etc-selinux\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.730907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730473    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-run\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.730907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730507    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-etc-kubernetes\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.730907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730542    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41e422ba-4ef6-44da-8f45-a57714ce78b8-host-slash\") pod \"iptables-alerter-gqm8p\" (UID: \"41e422ba-4ef6-44da-8f45-a57714ce78b8\") " pod="openshift-network-operator/iptables-alerter-gqm8p"
Sep 06 10:21:49.730907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730567    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4733769-37b3-443b-9ee5-d93bd5f167f0-ovn-node-metrics-cert\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.730907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730595    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-etc-sysctl-conf\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.730907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730619    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-host-var-lib-kubelet\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.730907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730647    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjzfd\" (UniqueName: \"kubernetes.io/projected/705da257-7931-44ef-89b4-070ba34f4cb0-kube-api-access-wjzfd\") pod \"network-metrics-daemon-6prgq\" (UID: \"705da257-7931-44ef-89b4-070ba34f4cb0\") " pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:21:49.730907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730673    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1fec0b65-b25f-4f26-9dd5-facb730de5a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.730907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730700    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58f272b6-b27a-4514-b8a9-a77b936c8cd2-sys-fs\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.731445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730725    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.731445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730771    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c2cc\" (UniqueName: \"kubernetes.io/projected/a6463314-419e-4775-b0b7-848374626327-kube-api-access-5c2cc\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.731445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730801    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-host-run-k8s-cni-cncf-io\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.731445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730822    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0afff6f-56fa-47c8-81ed-e519bde388ba-multus-daemon-config\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.731445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730846    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e728c52-da89-4425-b478-c21e3eea361a-hosts-file\") pod \"node-resolver-mtfnz\" (UID: \"3e728c52-da89-4425-b478-c21e3eea361a\") " pod="openshift-dns/node-resolver-mtfnz"
Sep 06 10:21:49.731445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730862    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqpmj\" (UniqueName: \"kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj\") pod \"network-check-target-gdhpd\" (UID: \"77c1dc1a-0efd-4422-842c-c630206d37a0\") " pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:21:49.731445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730876    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4733769-37b3-443b-9ee5-d93bd5f167f0-env-overrides\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.731445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730891    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e601580-f2cf-423c-bf46-337104486a51-host\") pod \"node-ca-zr4w8\" (UID: \"4e601580-f2cf-423c-bf46-337104486a51\") " pod="openshift-image-registry/node-ca-zr4w8"
Sep 06 10:21:49.731445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730906    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4733769-37b3-443b-9ee5-d93bd5f167f0-ovnkube-config\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.731445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730927    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-host-var-lib-cni-bin\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.731445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730956    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58f272b6-b27a-4514-b8a9-a77b936c8cd2-device-dir\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.731445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730971    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-node-log\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.731445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.730986    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4733769-37b3-443b-9ee5-d93bd5f167f0-ovnkube-script-lib\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.731445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.731022    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-etc-sysconfig\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.731445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.731048    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-cnibin\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.731445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.731067    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-multus-socket-dir-parent\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.731445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.731083    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-host-run-netns\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.731969 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.731098    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs\") pod \"network-metrics-daemon-6prgq\" (UID: \"705da257-7931-44ef-89b4-070ba34f4cb0\") " pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:21:49.731969 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.731114    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk4dt\" (UniqueName: \"kubernetes.io/projected/58f272b6-b27a-4514-b8a9-a77b936c8cd2-kube-api-access-gk4dt\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.731969 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.731128    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-lib-modules\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.731969 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.731143    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-multus-conf-dir\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.731969 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.731158    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e728c52-da89-4425-b478-c21e3eea361a-tmp-dir\") pod \"node-resolver-mtfnz\" (UID: \"3e728c52-da89-4425-b478-c21e3eea361a\") " pod="openshift-dns/node-resolver-mtfnz"
Sep 06 10:21:49.731969 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.731173    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1fec0b65-b25f-4f26-9dd5-facb730de5a8-system-cni-dir\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.731969 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.731188    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-log-socket\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.820751 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:49.820717    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dd0ee06e29e903dab72058d7f78cdf8.slice/crio-626d1c642ab8044366144b1796fedbc3ad4985a5f65f264c0d74a13b59a8b7af WatchSource:0}: Error finding container 626d1c642ab8044366144b1796fedbc3ad4985a5f65f264c0d74a13b59a8b7af: Status 404 returned error can't find the container with id 626d1c642ab8044366144b1796fedbc3ad4985a5f65f264c0d74a13b59a8b7af
Sep 06 10:21:49.822105 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:49.822079    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod883f5516537eee85b2309f7c3e4b7df0.slice/crio-dd303a38192910259d493a76bf7d0e3657685bf8e67184cc90ff296d9f09bf55 WatchSource:0}: Error finding container dd303a38192910259d493a76bf7d0e3657685bf8e67184cc90ff296d9f09bf55: Status 404 returned error can't find the container with id dd303a38192910259d493a76bf7d0e3657685bf8e67184cc90ff296d9f09bf55
Sep 06 10:21:49.827043 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.827020    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 10:21:49.831991 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.831969    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c2cc\" (UniqueName: \"kubernetes.io/projected/a6463314-419e-4775-b0b7-848374626327-kube-api-access-5c2cc\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.832057 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832002    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-host-run-k8s-cni-cncf-io\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.832057 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832018    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0afff6f-56fa-47c8-81ed-e519bde388ba-multus-daemon-config\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.832057 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832044    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e728c52-da89-4425-b478-c21e3eea361a-hosts-file\") pod \"node-resolver-mtfnz\" (UID: \"3e728c52-da89-4425-b478-c21e3eea361a\") " pod="openshift-dns/node-resolver-mtfnz"
Sep 06 10:21:49.832189 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832080    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqpmj\" (UniqueName: \"kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj\") pod \"network-check-target-gdhpd\" (UID: \"77c1dc1a-0efd-4422-842c-c630206d37a0\") " pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:21:49.832189 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832097    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-host-run-k8s-cni-cncf-io\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.832189 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832104    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4733769-37b3-443b-9ee5-d93bd5f167f0-env-overrides\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.832189 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832155    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e601580-f2cf-423c-bf46-337104486a51-host\") pod \"node-ca-zr4w8\" (UID: \"4e601580-f2cf-423c-bf46-337104486a51\") " pod="openshift-image-registry/node-ca-zr4w8"
Sep 06 10:21:49.832189 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832183    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4733769-37b3-443b-9ee5-d93bd5f167f0-ovnkube-config\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.832457 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832209    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-host-var-lib-cni-bin\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.832457 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832213    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3e728c52-da89-4425-b478-c21e3eea361a-hosts-file\") pod \"node-resolver-mtfnz\" (UID: \"3e728c52-da89-4425-b478-c21e3eea361a\") " pod="openshift-dns/node-resolver-mtfnz"
Sep 06 10:21:49.832457 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832239    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58f272b6-b27a-4514-b8a9-a77b936c8cd2-device-dir\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.832457 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832265    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-node-log\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.832457 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832309    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4733769-37b3-443b-9ee5-d93bd5f167f0-ovnkube-script-lib\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.832457 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832334    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e601580-f2cf-423c-bf46-337104486a51-host\") pod \"node-ca-zr4w8\" (UID: \"4e601580-f2cf-423c-bf46-337104486a51\") " pod="openshift-image-registry/node-ca-zr4w8"
Sep 06 10:21:49.832457 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832452    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-etc-sysconfig\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.832819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-cnibin\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.832819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832500    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58f272b6-b27a-4514-b8a9-a77b936c8cd2-device-dir\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.832819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832528    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-multus-socket-dir-parent\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.832819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832550    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-host-var-lib-cni-bin\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.832819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832555    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-host-run-netns\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.832819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832588    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs\") pod \"network-metrics-daemon-6prgq\" (UID: \"705da257-7931-44ef-89b4-070ba34f4cb0\") " pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:21:49.832819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832601    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-host-run-netns\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.832819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832616    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk4dt\" (UniqueName: \"kubernetes.io/projected/58f272b6-b27a-4514-b8a9-a77b936c8cd2-kube-api-access-gk4dt\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.832819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832643    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-lib-modules\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.832819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832639    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4733769-37b3-443b-9ee5-d93bd5f167f0-env-overrides\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.832819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832447    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-node-log\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.832819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832669    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-multus-conf-dir\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.832819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832696    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e728c52-da89-4425-b478-c21e3eea361a-tmp-dir\") pod \"node-resolver-mtfnz\" (UID: \"3e728c52-da89-4425-b478-c21e3eea361a\") " pod="openshift-dns/node-resolver-mtfnz"
Sep 06 10:21:49.832819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832662    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-etc-sysconfig\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.832819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832715    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-cnibin\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.832819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832721    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1fec0b65-b25f-4f26-9dd5-facb730de5a8-system-cni-dir\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.832819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832747    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-log-socket\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.832819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832748    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e0afff6f-56fa-47c8-81ed-e519bde388ba-multus-daemon-config\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.833816 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832763    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-multus-socket-dir-parent\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.833816 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832773    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-host-var-lib-cni-multus\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.833816 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:49.832810    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 10:21:49.833816 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832817    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1fec0b65-b25f-4f26-9dd5-facb730de5a8-system-cni-dir\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.833816 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832820    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4733769-37b3-443b-9ee5-d93bd5f167f0-ovnkube-config\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.833816 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832823    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-host-var-lib-cni-multus\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.833816 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832855    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-multus-conf-dir\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.833816 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:49.832874    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs podName:705da257-7931-44ef-89b4-070ba34f4cb0 nodeName:}" failed. No retries permitted until 2026-09-06 10:21:50.332851898 +0000 UTC m=+2.111271294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs") pod "network-metrics-daemon-6prgq" (UID: "705da257-7931-44ef-89b4-070ba34f4cb0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 10:21:49.833816 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832902    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-log-socket\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.833816 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832903    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-lib-modules\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.833816 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832922    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwjgx\" (UniqueName: \"kubernetes.io/projected/3e728c52-da89-4425-b478-c21e3eea361a-kube-api-access-pwjgx\") pod \"node-resolver-mtfnz\" (UID: \"3e728c52-da89-4425-b478-c21e3eea361a\") " pod="openshift-dns/node-resolver-mtfnz"
Sep 06 10:21:49.833816 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832950    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41e422ba-4ef6-44da-8f45-a57714ce78b8-iptables-alerter-script\") pod \"iptables-alerter-gqm8p\" (UID: \"41e422ba-4ef6-44da-8f45-a57714ce78b8\") " pod="openshift-network-operator/iptables-alerter-gqm8p"
Sep 06 10:21:49.833816 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832975    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-dbus\") pod \"global-pull-secret-syncer-nkc66\" (UID: \"4ff152b4-4c19-4c64-af60-41eeb9cbb81e\") " pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:21:49.833816 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.832978    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4733769-37b3-443b-9ee5-d93bd5f167f0-ovnkube-script-lib\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.833816 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833062    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-dbus\") pod \"global-pull-secret-syncer-nkc66\" (UID: \"4ff152b4-4c19-4c64-af60-41eeb9cbb81e\") " pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:21:49.833816 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833085    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-kubelet\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.833816 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833115    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-slash\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.834798 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833140    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-var-lib-openvswitch\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.834798 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833144    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e728c52-da89-4425-b478-c21e3eea361a-tmp-dir\") pod \"node-resolver-mtfnz\" (UID: \"3e728c52-da89-4425-b478-c21e3eea361a\") " pod="openshift-dns/node-resolver-mtfnz"
Sep 06 10:21:49.834798 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833165    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-hostroot\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.834798 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833191    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret\") pod \"global-pull-secret-syncer-nkc66\" (UID: \"4ff152b4-4c19-4c64-af60-41eeb9cbb81e\") " pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:21:49.834798 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833198    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-var-lib-openvswitch\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.834798 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833213    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-etc-sysctl-d\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.834798 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833230    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4268319-f028-4865-857a-4b453a4c42fd-konnectivity-ca\") pod \"konnectivity-agent-fnht9\" (UID: \"f4268319-f028-4865-857a-4b453a4c42fd\") " pod="kube-system/konnectivity-agent-fnht9"
Sep 06 10:21:49.834798 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833209    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-slash\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.834798 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833243    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-kubelet\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.834798 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833254    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-run-netns\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.834798 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:49.833280    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 10:21:49.834798 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833296    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-run-netns\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.834798 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833303    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-run-systemd\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.834798 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:49.833344    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret podName:4ff152b4-4c19-4c64-af60-41eeb9cbb81e nodeName:}" failed. No retries permitted until 2026-09-06 10:21:50.333323827 +0000 UTC m=+2.111743220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret") pod "global-pull-secret-syncer-nkc66" (UID: "4ff152b4-4c19-4c64-af60-41eeb9cbb81e") : object "kube-system"/"original-pull-secret" not registered
Sep 06 10:21:49.834798 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833349    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-etc-sysctl-d\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.834798 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833342    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-run-systemd\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.834798 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833367    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-etc-systemd\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.835876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833412    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-etc-systemd\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.835876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833421    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-multus-cni-dir\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.835876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833297    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-hostroot\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.835876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833452    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1fec0b65-b25f-4f26-9dd5-facb730de5a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.835876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833470    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-multus-cni-dir\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.835876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833484    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4268319-f028-4865-857a-4b453a4c42fd-agent-certs\") pod \"konnectivity-agent-fnht9\" (UID: \"f4268319-f028-4865-857a-4b453a4c42fd\") " pod="kube-system/konnectivity-agent-fnht9"
Sep 06 10:21:49.835876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833511    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58f272b6-b27a-4514-b8a9-a77b936c8cd2-socket-dir\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.835876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833514    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/41e422ba-4ef6-44da-8f45-a57714ce78b8-iptables-alerter-script\") pod \"iptables-alerter-gqm8p\" (UID: \"41e422ba-4ef6-44da-8f45-a57714ce78b8\") " pod="openshift-network-operator/iptables-alerter-gqm8p"
Sep 06 10:21:49.835876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833633    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-cni-bin\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.835876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833664    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.835876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833693    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-var-lib-kubelet\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.835876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833718    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1fec0b65-b25f-4f26-9dd5-facb730de5a8-cnibin\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.835876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833729    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-cni-bin\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.835876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833741    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-cni-netd\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.835876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833756    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58f272b6-b27a-4514-b8a9-a77b936c8cd2-socket-dir\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.835876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833767    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-system-cni-dir\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.835876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833781    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.836839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833800    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-host-run-multus-certs\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.836839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833812    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-system-cni-dir\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.836839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833823    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-cni-netd\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.836839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833826    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4e601580-f2cf-423c-bf46-337104486a51-serviceca\") pod \"node-ca-zr4w8\" (UID: \"4e601580-f2cf-423c-bf46-337104486a51\") " pod="openshift-image-registry/node-ca-zr4w8"
Sep 06 10:21:49.836839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833857    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-var-lib-kubelet\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.836839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833857    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58f272b6-b27a-4514-b8a9-a77b936c8cd2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.836839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833869    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f4268319-f028-4865-857a-4b453a4c42fd-konnectivity-ca\") pod \"konnectivity-agent-fnht9\" (UID: \"f4268319-f028-4865-857a-4b453a4c42fd\") " pod="kube-system/konnectivity-agent-fnht9"
Sep 06 10:21:49.836839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833891    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flpw7\" (UniqueName: \"kubernetes.io/projected/a4733769-37b3-443b-9ee5-d93bd5f167f0-kube-api-access-flpw7\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.836839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833896    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1fec0b65-b25f-4f26-9dd5-facb730de5a8-cnibin\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.836839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833904    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 06 10:21:49.836839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833919    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-etc-kubernetes\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.836839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833937    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-host\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.836839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833939    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-host-run-multus-certs\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.836839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833951    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6463314-419e-4775-b0b7-848374626327-etc-tuned\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.836839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833950    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58f272b6-b27a-4514-b8a9-a77b936c8cd2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.836839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833987    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1fec0b65-b25f-4f26-9dd5-facb730de5a8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.836839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.833993    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-etc-kubernetes\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.836839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834015    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6463314-419e-4775-b0b7-848374626327-tmp\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.837628 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834049    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwljr\" (UniqueName: \"kubernetes.io/projected/1fec0b65-b25f-4f26-9dd5-facb730de5a8-kube-api-access-bwljr\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.837628 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834059    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-host\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.837628 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834078    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2s2l\" (UniqueName: \"kubernetes.io/projected/41e422ba-4ef6-44da-8f45-a57714ce78b8-kube-api-access-b2s2l\") pod \"iptables-alerter-gqm8p\" (UID: \"41e422ba-4ef6-44da-8f45-a57714ce78b8\") " pod="openshift-network-operator/iptables-alerter-gqm8p"
Sep 06 10:21:49.837628 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834143    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-kubelet-config\") pod \"global-pull-secret-syncer-nkc66\" (UID: \"4ff152b4-4c19-4c64-af60-41eeb9cbb81e\") " pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:21:49.837628 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834172    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-etc-openvswitch\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.837628 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834197    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-sys\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.837628 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834227    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh2sv\" (UniqueName: \"kubernetes.io/projected/e0afff6f-56fa-47c8-81ed-e519bde388ba-kube-api-access-qh2sv\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.837628 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834255    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1fec0b65-b25f-4f26-9dd5-facb730de5a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.837628 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834268    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4e601580-f2cf-423c-bf46-337104486a51-serviceca\") pod \"node-ca-zr4w8\" (UID: \"4e601580-f2cf-423c-bf46-337104486a51\") " pod="openshift-image-registry/node-ca-zr4w8"
Sep 06 10:21:49.837628 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834283    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-systemd-units\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.837628 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834322    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-run-openvswitch\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.837628 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834334    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-systemd-units\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.837628 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834350    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-run-ovn\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.837628 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834371    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-sys\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.837628 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834437    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-run-openvswitch\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.837628 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834483    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-run-ovn\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.837628 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834488    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-etc-modprobe-d\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.838280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834377    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-etc-modprobe-d\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.838280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834528    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-etc-openvswitch\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.838280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834537    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0afff6f-56fa-47c8-81ed-e519bde388ba-cni-binary-copy\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.838280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834552    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-kubelet-config\") pod \"global-pull-secret-syncer-nkc66\" (UID: \"4ff152b4-4c19-4c64-af60-41eeb9cbb81e\") " pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:21:49.838280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834561    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbwxc\" (UniqueName: \"kubernetes.io/projected/4e601580-f2cf-423c-bf46-337104486a51-kube-api-access-fbwxc\") pod \"node-ca-zr4w8\" (UID: \"4e601580-f2cf-423c-bf46-337104486a51\") " pod="openshift-image-registry/node-ca-zr4w8"
Sep 06 10:21:49.838280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834609    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1fec0b65-b25f-4f26-9dd5-facb730de5a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.838280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834630    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58f272b6-b27a-4514-b8a9-a77b936c8cd2-registration-dir\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.838280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834653    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58f272b6-b27a-4514-b8a9-a77b936c8cd2-etc-selinux\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.838280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834670    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-run\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.838280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834687    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-etc-kubernetes\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.838280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834709    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41e422ba-4ef6-44da-8f45-a57714ce78b8-host-slash\") pod \"iptables-alerter-gqm8p\" (UID: \"41e422ba-4ef6-44da-8f45-a57714ce78b8\") " pod="openshift-network-operator/iptables-alerter-gqm8p"
Sep 06 10:21:49.838280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834742    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4733769-37b3-443b-9ee5-d93bd5f167f0-ovn-node-metrics-cert\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.838280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834766    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-etc-sysctl-conf\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.838280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834791    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-host-var-lib-kubelet\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.838280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834827    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjzfd\" (UniqueName: \"kubernetes.io/projected/705da257-7931-44ef-89b4-070ba34f4cb0-kube-api-access-wjzfd\") pod \"network-metrics-daemon-6prgq\" (UID: \"705da257-7931-44ef-89b4-070ba34f4cb0\") " pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:21:49.838280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834854    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1fec0b65-b25f-4f26-9dd5-facb730de5a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.838280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834880    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58f272b6-b27a-4514-b8a9-a77b936c8cd2-sys-fs\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.838873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834908    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.838873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834954    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/41e422ba-4ef6-44da-8f45-a57714ce78b8-host-slash\") pod \"iptables-alerter-gqm8p\" (UID: \"41e422ba-4ef6-44da-8f45-a57714ce78b8\") " pod="openshift-network-operator/iptables-alerter-gqm8p"
Sep 06 10:21:49.838873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834989    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4733769-37b3-443b-9ee5-d93bd5f167f0-host-run-ovn-kubernetes\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.838873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.835043    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-host-var-lib-kubelet\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.838873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.835098    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1fec0b65-b25f-4f26-9dd5-facb730de5a8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.838873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.835126    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0afff6f-56fa-47c8-81ed-e519bde388ba-cni-binary-copy\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.838873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.835150    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58f272b6-b27a-4514-b8a9-a77b936c8cd2-registration-dir\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.838873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.835189    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58f272b6-b27a-4514-b8a9-a77b936c8cd2-sys-fs\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.838873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.835194    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58f272b6-b27a-4514-b8a9-a77b936c8cd2-etc-selinux\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.838873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.834995    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1fec0b65-b25f-4f26-9dd5-facb730de5a8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.838873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.835238    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-run\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.838873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.835302    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e0afff6f-56fa-47c8-81ed-e519bde388ba-etc-kubernetes\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.838873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.835374    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6463314-419e-4775-b0b7-848374626327-etc-sysctl-conf\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.838873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.835630    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1fec0b65-b25f-4f26-9dd5-facb730de5a8-cni-binary-copy\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.838873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.837269    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6463314-419e-4775-b0b7-848374626327-tmp\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.838873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.837556    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6463314-419e-4775-b0b7-848374626327-etc-tuned\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.838873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.837655    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4733769-37b3-443b-9ee5-d93bd5f167f0-ovn-node-metrics-cert\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.839485 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.837744    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f4268319-f028-4865-857a-4b453a4c42fd-agent-certs\") pod \"konnectivity-agent-fnht9\" (UID: \"f4268319-f028-4865-857a-4b453a4c42fd\") " pod="kube-system/konnectivity-agent-fnht9"
Sep 06 10:21:49.845059 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:49.845035    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 10:21:49.845059 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:49.845061    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 10:21:49.845165 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:49.845072    2561 projected.go:196] Error preparing data for projected volume kube-api-access-hqpmj for pod openshift-network-diagnostics/network-check-target-gdhpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 10:21:49.845165 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:49.845121    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj podName:77c1dc1a-0efd-4422-842c-c630206d37a0 nodeName:}" failed. No retries permitted until 2026-09-06 10:21:50.345105366 +0000 UTC m=+2.123524783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hqpmj" (UniqueName: "kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj") pod "network-check-target-gdhpd" (UID: "77c1dc1a-0efd-4422-842c-c630206d37a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 10:21:49.846028 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.846005    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c2cc\" (UniqueName: \"kubernetes.io/projected/a6463314-419e-4775-b0b7-848374626327-kube-api-access-5c2cc\") pod \"tuned-q2c9s\" (UID: \"a6463314-419e-4775-b0b7-848374626327\") " pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.846875 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.846853    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwjgx\" (UniqueName: \"kubernetes.io/projected/3e728c52-da89-4425-b478-c21e3eea361a-kube-api-access-pwjgx\") pod \"node-resolver-mtfnz\" (UID: \"3e728c52-da89-4425-b478-c21e3eea361a\") " pod="openshift-dns/node-resolver-mtfnz"
Sep 06 10:21:49.847617 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.847595    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2s2l\" (UniqueName: \"kubernetes.io/projected/41e422ba-4ef6-44da-8f45-a57714ce78b8-kube-api-access-b2s2l\") pod \"iptables-alerter-gqm8p\" (UID: \"41e422ba-4ef6-44da-8f45-a57714ce78b8\") " pod="openshift-network-operator/iptables-alerter-gqm8p"
Sep 06 10:21:49.850408 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.850380    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwljr\" (UniqueName: \"kubernetes.io/projected/1fec0b65-b25f-4f26-9dd5-facb730de5a8-kube-api-access-bwljr\") pod \"multus-additional-cni-plugins-h6wfp\" (UID: \"1fec0b65-b25f-4f26-9dd5-facb730de5a8\") " pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:49.853983 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.853951    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjzfd\" (UniqueName: \"kubernetes.io/projected/705da257-7931-44ef-89b4-070ba34f4cb0-kube-api-access-wjzfd\") pod \"network-metrics-daemon-6prgq\" (UID: \"705da257-7931-44ef-89b4-070ba34f4cb0\") " pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:21:49.854075 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.854016    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbwxc\" (UniqueName: \"kubernetes.io/projected/4e601580-f2cf-423c-bf46-337104486a51-kube-api-access-fbwxc\") pod \"node-ca-zr4w8\" (UID: \"4e601580-f2cf-423c-bf46-337104486a51\") " pod="openshift-image-registry/node-ca-zr4w8"
Sep 06 10:21:49.854316 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.854297    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk4dt\" (UniqueName: \"kubernetes.io/projected/58f272b6-b27a-4514-b8a9-a77b936c8cd2-kube-api-access-gk4dt\") pod \"aws-ebs-csi-driver-node-68kb6\" (UID: \"58f272b6-b27a-4514-b8a9-a77b936c8cd2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:49.854367 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.854354    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flpw7\" (UniqueName: \"kubernetes.io/projected/a4733769-37b3-443b-9ee5-d93bd5f167f0-kube-api-access-flpw7\") pod \"ovnkube-node-bsw6t\" (UID: \"a4733769-37b3-443b-9ee5-d93bd5f167f0\") " pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:49.854625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.854608    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh2sv\" (UniqueName: \"kubernetes.io/projected/e0afff6f-56fa-47c8-81ed-e519bde388ba-kube-api-access-qh2sv\") pod \"multus-5pbf6\" (UID: \"e0afff6f-56fa-47c8-81ed-e519bde388ba\") " pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:49.963821 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.963727    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fnht9"
Sep 06 10:21:49.972488 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.972461    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q2c9s"
Sep 06 10:21:49.973860 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:49.973834    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4268319_f028_4865_857a_4b453a4c42fd.slice/crio-2ecba0cd9f1fe42209c2f61520b66f5ab96e4f525a693c0dedb1bda5b926b9a8 WatchSource:0}: Error finding container 2ecba0cd9f1fe42209c2f61520b66f5ab96e4f525a693c0dedb1bda5b926b9a8: Status 404 returned error can't find the container with id 2ecba0cd9f1fe42209c2f61520b66f5ab96e4f525a693c0dedb1bda5b926b9a8
Sep 06 10:21:49.981565 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:49.981544    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6463314_419e_4775_b0b7_848374626327.slice/crio-59f9d12679d9e256bf883c73dd03b9e50f3d998f970469d5a3a91ddbf99aef61 WatchSource:0}: Error finding container 59f9d12679d9e256bf883c73dd03b9e50f3d998f970469d5a3a91ddbf99aef61: Status 404 returned error can't find the container with id 59f9d12679d9e256bf883c73dd03b9e50f3d998f970469d5a3a91ddbf99aef61
Sep 06 10:21:49.995518 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:49.995497    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5pbf6"
Sep 06 10:21:50.004537 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:50.004509    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0afff6f_56fa_47c8_81ed_e519bde388ba.slice/crio-f5107e846338fbaa8851d24817289346561b0a62f3c01fb6529d447f6c42dfe8 WatchSource:0}: Error finding container f5107e846338fbaa8851d24817289346561b0a62f3c01fb6529d447f6c42dfe8: Status 404 returned error can't find the container with id f5107e846338fbaa8851d24817289346561b0a62f3c01fb6529d447f6c42dfe8
Sep 06 10:21:50.010779 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.010764    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gqm8p"
Sep 06 10:21:50.018943 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:50.018916    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41e422ba_4ef6_44da_8f45_a57714ce78b8.slice/crio-950f032ff92c84e729bfdc9534120b6b2a74038cf7329d42eb8d5c743bbfcf50 WatchSource:0}: Error finding container 950f032ff92c84e729bfdc9534120b6b2a74038cf7329d42eb8d5c743bbfcf50: Status 404 returned error can't find the container with id 950f032ff92c84e729bfdc9534120b6b2a74038cf7329d42eb8d5c743bbfcf50
Sep 06 10:21:50.025297 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.025279    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6"
Sep 06 10:21:50.041861 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.041839    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mtfnz"
Sep 06 10:21:50.050102 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:50.050081    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e728c52_da89_4425_b478_c21e3eea361a.slice/crio-e06e26e39c5c805b0f3aeee04f6f64f315a69eee03139ddf8fe6aad2fd4d3bd4 WatchSource:0}: Error finding container e06e26e39c5c805b0f3aeee04f6f64f315a69eee03139ddf8fe6aad2fd4d3bd4: Status 404 returned error can't find the container with id e06e26e39c5c805b0f3aeee04f6f64f315a69eee03139ddf8fe6aad2fd4d3bd4
Sep 06 10:21:50.059149 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.059131    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zr4w8"
Sep 06 10:21:50.067813 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:50.067791    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e601580_f2cf_423c_bf46_337104486a51.slice/crio-5fac4aec61ce8adf587a818f646b8293f587b0f080ddb68a275df0ff6e35f2d5 WatchSource:0}: Error finding container 5fac4aec61ce8adf587a818f646b8293f587b0f080ddb68a275df0ff6e35f2d5: Status 404 returned error can't find the container with id 5fac4aec61ce8adf587a818f646b8293f587b0f080ddb68a275df0ff6e35f2d5
Sep 06 10:21:50.075913 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.075894    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h6wfp"
Sep 06 10:21:50.080042 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.079996    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:21:50.088482 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:50.088455    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fec0b65_b25f_4f26_9dd5_facb730de5a8.slice/crio-8140e42f3893c98f5b11244ed8eaacae8a90e5e8969362c2e48c955bfbaaeefc WatchSource:0}: Error finding container 8140e42f3893c98f5b11244ed8eaacae8a90e5e8969362c2e48c955bfbaaeefc: Status 404 returned error can't find the container with id 8140e42f3893c98f5b11244ed8eaacae8a90e5e8969362c2e48c955bfbaaeefc
Sep 06 10:21:50.091709 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:21:50.091688    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4733769_37b3_443b_9ee5_d93bd5f167f0.slice/crio-e01cbbbc3dec00c0b56840c0ab4e4edd45379b890243e06db3ae349d2e69aa6a WatchSource:0}: Error finding container e01cbbbc3dec00c0b56840c0ab4e4edd45379b890243e06db3ae349d2e69aa6a: Status 404 returned error can't find the container with id e01cbbbc3dec00c0b56840c0ab4e4edd45379b890243e06db3ae349d2e69aa6a
Sep 06 10:21:50.107318 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.107298    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 10:21:50.337378 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.337266    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs\") pod \"network-metrics-daemon-6prgq\" (UID: \"705da257-7931-44ef-89b4-070ba34f4cb0\") " pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:21:50.337378 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.337306    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret\") pod \"global-pull-secret-syncer-nkc66\" (UID: \"4ff152b4-4c19-4c64-af60-41eeb9cbb81e\") " pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:21:50.337578 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:50.337445    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 10:21:50.337578 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:50.337507    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret podName:4ff152b4-4c19-4c64-af60-41eeb9cbb81e nodeName:}" failed. No retries permitted until 2026-09-06 10:21:51.337489854 +0000 UTC m=+3.115909251 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret") pod "global-pull-secret-syncer-nkc66" (UID: "4ff152b4-4c19-4c64-af60-41eeb9cbb81e") : object "kube-system"/"original-pull-secret" not registered
Sep 06 10:21:50.337578 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:50.337445    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 10:21:50.337723 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:50.337608    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs podName:705da257-7931-44ef-89b4-070ba34f4cb0 nodeName:}" failed. No retries permitted until 2026-09-06 10:21:51.337586908 +0000 UTC m=+3.116006319 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs") pod "network-metrics-daemon-6prgq" (UID: "705da257-7931-44ef-89b4-070ba34f4cb0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 10:21:50.416260 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.416224    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 10:21:50.438343 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.438303    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqpmj\" (UniqueName: \"kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj\") pod \"network-check-target-gdhpd\" (UID: \"77c1dc1a-0efd-4422-842c-c630206d37a0\") " pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:21:50.438653 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:50.438628    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 10:21:50.438744 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:50.438662    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 10:21:50.438744 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:50.438676    2561 projected.go:196] Error preparing data for projected volume kube-api-access-hqpmj for pod openshift-network-diagnostics/network-check-target-gdhpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 10:21:50.438865 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:50.438839    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj podName:77c1dc1a-0efd-4422-842c-c630206d37a0 nodeName:}" failed. No retries permitted until 2026-09-06 10:21:51.438732077 +0000 UTC m=+3.217151475 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hqpmj" (UniqueName: "kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj") pod "network-check-target-gdhpd" (UID: "77c1dc1a-0efd-4422-842c-c630206d37a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 10:21:50.672989 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.672877    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 10:16:50 +0000 UTC" deadline="2028-06-18 22:13:37.82361004 +0000 UTC"
Sep 06 10:21:50.672989 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.672946    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15635h51m47.150667894s"
Sep 06 10:21:50.775891 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.775804    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5pbf6" event={"ID":"e0afff6f-56fa-47c8-81ed-e519bde388ba","Type":"ContainerStarted","Data":"f5107e846338fbaa8851d24817289346561b0a62f3c01fb6529d447f6c42dfe8"}
Sep 06 10:21:50.788216 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.788169    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q2c9s" event={"ID":"a6463314-419e-4775-b0b7-848374626327","Type":"ContainerStarted","Data":"59f9d12679d9e256bf883c73dd03b9e50f3d998f970469d5a3a91ddbf99aef61"}
Sep 06 10:21:50.795893 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.795859    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fnht9" event={"ID":"f4268319-f028-4865-857a-4b453a4c42fd","Type":"ContainerStarted","Data":"2ecba0cd9f1fe42209c2f61520b66f5ab96e4f525a693c0dedb1bda5b926b9a8"}
Sep 06 10:21:50.806115 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.806041    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal" event={"ID":"9dd0ee06e29e903dab72058d7f78cdf8","Type":"ContainerStarted","Data":"626d1c642ab8044366144b1796fedbc3ad4985a5f65f264c0d74a13b59a8b7af"}
Sep 06 10:21:50.823653 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.823612    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t" event={"ID":"a4733769-37b3-443b-9ee5-d93bd5f167f0","Type":"ContainerStarted","Data":"e01cbbbc3dec00c0b56840c0ab4e4edd45379b890243e06db3ae349d2e69aa6a"}
Sep 06 10:21:50.831342 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.831309    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6wfp" event={"ID":"1fec0b65-b25f-4f26-9dd5-facb730de5a8","Type":"ContainerStarted","Data":"8140e42f3893c98f5b11244ed8eaacae8a90e5e8969362c2e48c955bfbaaeefc"}
Sep 06 10:21:50.845073 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.845018    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mtfnz" event={"ID":"3e728c52-da89-4425-b478-c21e3eea361a","Type":"ContainerStarted","Data":"e06e26e39c5c805b0f3aeee04f6f64f315a69eee03139ddf8fe6aad2fd4d3bd4"}
Sep 06 10:21:50.870289 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.870181    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6" event={"ID":"58f272b6-b27a-4514-b8a9-a77b936c8cd2","Type":"ContainerStarted","Data":"4443da06cf55e2ae11f1a00131316c4fcdf7635f5814fbb0155a8fc02877ef3f"}
Sep 06 10:21:50.896265 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.896172    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gqm8p" event={"ID":"41e422ba-4ef6-44da-8f45-a57714ce78b8","Type":"ContainerStarted","Data":"950f032ff92c84e729bfdc9534120b6b2a74038cf7329d42eb8d5c743bbfcf50"}
Sep 06 10:21:50.918292 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.918258    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" event={"ID":"883f5516537eee85b2309f7c3e4b7df0","Type":"ContainerStarted","Data":"dd303a38192910259d493a76bf7d0e3657685bf8e67184cc90ff296d9f09bf55"}
Sep 06 10:21:50.932516 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:50.932408    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zr4w8" event={"ID":"4e601580-f2cf-423c-bf46-337104486a51","Type":"ContainerStarted","Data":"5fac4aec61ce8adf587a818f646b8293f587b0f080ddb68a275df0ff6e35f2d5"}
Sep 06 10:21:51.346360 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:51.346178    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs\") pod \"network-metrics-daemon-6prgq\" (UID: \"705da257-7931-44ef-89b4-070ba34f4cb0\") " pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:21:51.346360 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:51.346237    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret\") pod \"global-pull-secret-syncer-nkc66\" (UID: \"4ff152b4-4c19-4c64-af60-41eeb9cbb81e\") " pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:21:51.346656 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:51.346374    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 10:21:51.346656 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:51.346440    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret podName:4ff152b4-4c19-4c64-af60-41eeb9cbb81e nodeName:}" failed. No retries permitted until 2026-09-06 10:21:53.346419596 +0000 UTC m=+5.124838993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret") pod "global-pull-secret-syncer-nkc66" (UID: "4ff152b4-4c19-4c64-af60-41eeb9cbb81e") : object "kube-system"/"original-pull-secret" not registered
Sep 06 10:21:51.347000 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:51.346842    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 10:21:51.347000 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:51.346903    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs podName:705da257-7931-44ef-89b4-070ba34f4cb0 nodeName:}" failed. No retries permitted until 2026-09-06 10:21:53.346884304 +0000 UTC m=+5.125303699 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs") pod "network-metrics-daemon-6prgq" (UID: "705da257-7931-44ef-89b4-070ba34f4cb0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 10:21:51.448371 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:51.448316    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqpmj\" (UniqueName: \"kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj\") pod \"network-check-target-gdhpd\" (UID: \"77c1dc1a-0efd-4422-842c-c630206d37a0\") " pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:21:51.448580 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:51.448558    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 10:21:51.448649 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:51.448583    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 10:21:51.448649 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:51.448597    2561 projected.go:196] Error preparing data for projected volume kube-api-access-hqpmj for pod openshift-network-diagnostics/network-check-target-gdhpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 10:21:51.448761 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:51.448655    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj podName:77c1dc1a-0efd-4422-842c-c630206d37a0 nodeName:}" failed. No retries permitted until 2026-09-06 10:21:53.448635898 +0000 UTC m=+5.227055294 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hqpmj" (UniqueName: "kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj") pod "network-check-target-gdhpd" (UID: "77c1dc1a-0efd-4422-842c-c630206d37a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 10:21:51.673643 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:51.673525    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 10:16:50 +0000 UTC" deadline="2028-05-09 07:44:52.201563535 +0000 UTC"
Sep 06 10:21:51.673643 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:51.673562    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14661h23m0.528006943s"
Sep 06 10:21:51.752909 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:51.751895    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:21:51.752909 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:51.752057    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6prgq" podUID="705da257-7931-44ef-89b4-070ba34f4cb0"
Sep 06 10:21:51.752909 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:51.752492    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:21:51.752909 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:51.752590    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhpd" podUID="77c1dc1a-0efd-4422-842c-c630206d37a0"
Sep 06 10:21:51.752909 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:51.752673    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:21:51.752909 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:51.752756    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkc66" podUID="4ff152b4-4c19-4c64-af60-41eeb9cbb81e"
Sep 06 10:21:51.821730 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:51.821485    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 10:21:53.366550 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:53.366458    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs\") pod \"network-metrics-daemon-6prgq\" (UID: \"705da257-7931-44ef-89b4-070ba34f4cb0\") " pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:21:53.366550 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:53.366523    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret\") pod \"global-pull-secret-syncer-nkc66\" (UID: \"4ff152b4-4c19-4c64-af60-41eeb9cbb81e\") " pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:21:53.367085 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:53.366670    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 10:21:53.367085 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:53.366735    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret podName:4ff152b4-4c19-4c64-af60-41eeb9cbb81e nodeName:}" failed. No retries permitted until 2026-09-06 10:21:57.366715213 +0000 UTC m=+9.145134606 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret") pod "global-pull-secret-syncer-nkc66" (UID: "4ff152b4-4c19-4c64-af60-41eeb9cbb81e") : object "kube-system"/"original-pull-secret" not registered
Sep 06 10:21:53.367210 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:53.367177    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 10:21:53.367271 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:53.367227    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs podName:705da257-7931-44ef-89b4-070ba34f4cb0 nodeName:}" failed. No retries permitted until 2026-09-06 10:21:57.367211096 +0000 UTC m=+9.145630491 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs") pod "network-metrics-daemon-6prgq" (UID: "705da257-7931-44ef-89b4-070ba34f4cb0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 10:21:53.467279 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:53.467228    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqpmj\" (UniqueName: \"kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj\") pod \"network-check-target-gdhpd\" (UID: \"77c1dc1a-0efd-4422-842c-c630206d37a0\") " pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:21:53.467555 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:53.467534    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 10:21:53.467654 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:53.467563    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 10:21:53.467654 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:53.467577    2561 projected.go:196] Error preparing data for projected volume kube-api-access-hqpmj for pod openshift-network-diagnostics/network-check-target-gdhpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 10:21:53.467654 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:53.467646    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj podName:77c1dc1a-0efd-4422-842c-c630206d37a0 nodeName:}" failed. No retries permitted until 2026-09-06 10:21:57.467625871 +0000 UTC m=+9.246045265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hqpmj" (UniqueName: "kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj") pod "network-check-target-gdhpd" (UID: "77c1dc1a-0efd-4422-842c-c630206d37a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 10:21:53.748161 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:53.748125    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:21:53.748383 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:53.748271    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkc66" podUID="4ff152b4-4c19-4c64-af60-41eeb9cbb81e"
Sep 06 10:21:53.748774 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:53.748745    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:21:53.748915 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:53.748895    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6prgq" podUID="705da257-7931-44ef-89b4-070ba34f4cb0"
Sep 06 10:21:53.748997 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:53.748959    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:21:53.749060 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:53.749035    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhpd" podUID="77c1dc1a-0efd-4422-842c-c630206d37a0"
Sep 06 10:21:55.748394 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:55.748361    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:21:55.748915 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:55.748509    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkc66" podUID="4ff152b4-4c19-4c64-af60-41eeb9cbb81e"
Sep 06 10:21:55.748915 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:55.748892    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:21:55.749038 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:55.748999    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6prgq" podUID="705da257-7931-44ef-89b4-070ba34f4cb0"
Sep 06 10:21:55.749099 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:55.749056    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:21:55.749159 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:55.749134    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhpd" podUID="77c1dc1a-0efd-4422-842c-c630206d37a0"
Sep 06 10:21:57.401665 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:57.401358    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret\") pod \"global-pull-secret-syncer-nkc66\" (UID: \"4ff152b4-4c19-4c64-af60-41eeb9cbb81e\") " pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:21:57.402102 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:57.401682    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs\") pod \"network-metrics-daemon-6prgq\" (UID: \"705da257-7931-44ef-89b4-070ba34f4cb0\") " pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:21:57.402102 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:57.401514    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 10:21:57.402102 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:57.401844    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret podName:4ff152b4-4c19-4c64-af60-41eeb9cbb81e nodeName:}" failed. No retries permitted until 2026-09-06 10:22:05.40182519 +0000 UTC m=+17.180244581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret") pod "global-pull-secret-syncer-nkc66" (UID: "4ff152b4-4c19-4c64-af60-41eeb9cbb81e") : object "kube-system"/"original-pull-secret" not registered
Sep 06 10:21:57.402285 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:57.401776    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 10:21:57.402285 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:57.402205    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs podName:705da257-7931-44ef-89b4-070ba34f4cb0 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:05.402187089 +0000 UTC m=+17.180606484 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs") pod "network-metrics-daemon-6prgq" (UID: "705da257-7931-44ef-89b4-070ba34f4cb0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 10:21:57.502368 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:57.502331    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqpmj\" (UniqueName: \"kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj\") pod \"network-check-target-gdhpd\" (UID: \"77c1dc1a-0efd-4422-842c-c630206d37a0\") " pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:21:57.502529 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:57.502488    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 10:21:57.502529 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:57.502515    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 10:21:57.502529 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:57.502531    2561 projected.go:196] Error preparing data for projected volume kube-api-access-hqpmj for pod openshift-network-diagnostics/network-check-target-gdhpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 10:21:57.502703 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:57.502597    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj podName:77c1dc1a-0efd-4422-842c-c630206d37a0 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:05.502577827 +0000 UTC m=+17.280997230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hqpmj" (UniqueName: "kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj") pod "network-check-target-gdhpd" (UID: "77c1dc1a-0efd-4422-842c-c630206d37a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 10:21:57.748646 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:57.748563    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:21:57.748646 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:57.748617    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:21:57.748646 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:57.748634    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:21:57.748909 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:57.748774    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6prgq" podUID="705da257-7931-44ef-89b4-070ba34f4cb0"
Sep 06 10:21:57.749299 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:57.749179    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhpd" podUID="77c1dc1a-0efd-4422-842c-c630206d37a0"
Sep 06 10:21:57.749299 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:57.749269    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkc66" podUID="4ff152b4-4c19-4c64-af60-41eeb9cbb81e"
Sep 06 10:21:59.747831 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:59.747797    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:21:59.747831 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:59.747841    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:21:59.748370 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:21:59.747842    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:21:59.748370 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:59.747922    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhpd" podUID="77c1dc1a-0efd-4422-842c-c630206d37a0"
Sep 06 10:21:59.748370 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:59.748006    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkc66" podUID="4ff152b4-4c19-4c64-af60-41eeb9cbb81e"
Sep 06 10:21:59.748370 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:21:59.748121    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6prgq" podUID="705da257-7931-44ef-89b4-070ba34f4cb0"
Sep 06 10:22:01.748008 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:01.747975    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:22:01.748430 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:01.747975    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:22:01.748430 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:01.748084    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6prgq" podUID="705da257-7931-44ef-89b4-070ba34f4cb0"
Sep 06 10:22:01.748430 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:01.748136    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkc66" podUID="4ff152b4-4c19-4c64-af60-41eeb9cbb81e"
Sep 06 10:22:01.748430 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:01.747975    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:22:01.748430 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:01.748191    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhpd" podUID="77c1dc1a-0efd-4422-842c-c630206d37a0"
Sep 06 10:22:03.748192 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:03.748152    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:22:03.748672 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:03.748152    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:22:03.748672 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:03.748152    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:22:03.748672 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:03.748338    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6prgq" podUID="705da257-7931-44ef-89b4-070ba34f4cb0"
Sep 06 10:22:03.748672 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:03.748401    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhpd" podUID="77c1dc1a-0efd-4422-842c-c630206d37a0"
Sep 06 10:22:03.748672 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:03.748502    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkc66" podUID="4ff152b4-4c19-4c64-af60-41eeb9cbb81e"
Sep 06 10:22:05.465526 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:05.465484    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs\") pod \"network-metrics-daemon-6prgq\" (UID: \"705da257-7931-44ef-89b4-070ba34f4cb0\") " pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:22:05.465983 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:05.465538    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret\") pod \"global-pull-secret-syncer-nkc66\" (UID: \"4ff152b4-4c19-4c64-af60-41eeb9cbb81e\") " pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:22:05.465983 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:05.465633    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 10:22:05.465983 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:05.465643    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 10:22:05.465983 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:05.465695    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret podName:4ff152b4-4c19-4c64-af60-41eeb9cbb81e nodeName:}" failed. No retries permitted until 2026-09-06 10:22:21.465680439 +0000 UTC m=+33.244099834 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret") pod "global-pull-secret-syncer-nkc66" (UID: "4ff152b4-4c19-4c64-af60-41eeb9cbb81e") : object "kube-system"/"original-pull-secret" not registered
Sep 06 10:22:05.465983 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:05.465727    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs podName:705da257-7931-44ef-89b4-070ba34f4cb0 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:21.465705709 +0000 UTC m=+33.244125114 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs") pod "network-metrics-daemon-6prgq" (UID: "705da257-7931-44ef-89b4-070ba34f4cb0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 10:22:05.566277 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:05.566245    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqpmj\" (UniqueName: \"kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj\") pod \"network-check-target-gdhpd\" (UID: \"77c1dc1a-0efd-4422-842c-c630206d37a0\") " pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:22:05.566439 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:05.566393    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 10:22:05.566439 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:05.566407    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 10:22:05.566439 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:05.566418    2561 projected.go:196] Error preparing data for projected volume kube-api-access-hqpmj for pod openshift-network-diagnostics/network-check-target-gdhpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 10:22:05.566640 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:05.566465    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj podName:77c1dc1a-0efd-4422-842c-c630206d37a0 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:21.566451405 +0000 UTC m=+33.344870796 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hqpmj" (UniqueName: "kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj") pod "network-check-target-gdhpd" (UID: "77c1dc1a-0efd-4422-842c-c630206d37a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 10:22:05.748520 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:05.748449    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:22:05.748680 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:05.748449    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:22:05.748680 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:05.748566    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhpd" podUID="77c1dc1a-0efd-4422-842c-c630206d37a0"
Sep 06 10:22:05.748680 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:05.748631    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6prgq" podUID="705da257-7931-44ef-89b4-070ba34f4cb0"
Sep 06 10:22:05.748680 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:05.748449    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:22:05.748852 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:05.748717    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkc66" podUID="4ff152b4-4c19-4c64-af60-41eeb9cbb81e"
Sep 06 10:22:07.747937 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:07.747900    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:22:07.748412 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:07.747909    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:22:07.748412 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:07.748043    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:22:07.748412 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:07.748040    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6prgq" podUID="705da257-7931-44ef-89b4-070ba34f4cb0"
Sep 06 10:22:07.748412 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:07.748151    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkc66" podUID="4ff152b4-4c19-4c64-af60-41eeb9cbb81e"
Sep 06 10:22:07.748412 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:07.748238    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhpd" podUID="77c1dc1a-0efd-4422-842c-c630206d37a0"
Sep 06 10:22:09.747760 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:09.747730    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:22:09.748399 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:09.747765    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:22:09.748399 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:09.747829    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkc66" podUID="4ff152b4-4c19-4c64-af60-41eeb9cbb81e"
Sep 06 10:22:09.748399 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:09.747892    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6prgq" podUID="705da257-7931-44ef-89b4-070ba34f4cb0"
Sep 06 10:22:09.748399 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:09.747945    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:22:09.748399 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:09.748002    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhpd" podUID="77c1dc1a-0efd-4422-842c-c630206d37a0"
Sep 06 10:22:09.979856 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:09.979623    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q2c9s" event={"ID":"a6463314-419e-4775-b0b7-848374626327","Type":"ContainerStarted","Data":"c520594fc08de0dd9896256c5f4bbdc071a328841cd3fd9853be40c728e3d9d6"}
Sep 06 10:22:09.980980 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:09.980957    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal" event={"ID":"9dd0ee06e29e903dab72058d7f78cdf8","Type":"ContainerStarted","Data":"9d4cc7294faa1113d229ba0ff9fa4f13e3e71652a2f56e44c5853d2a518187a6"}
Sep 06 10:22:09.984094 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:09.984072    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t" event={"ID":"a4733769-37b3-443b-9ee5-d93bd5f167f0","Type":"ContainerStarted","Data":"193a4212705b6c2284f7b3891b6ebed5e2ad2577944feb257b7612067096f534"}
Sep 06 10:22:09.984181 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:09.984144    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t" event={"ID":"a4733769-37b3-443b-9ee5-d93bd5f167f0","Type":"ContainerStarted","Data":"7059dadd4e18e8c3d0e9612a8e7cfd375d6403f51ddcef57238517751137fc0c"}
Sep 06 10:22:09.996515 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:09.996478    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-q2c9s" podStartSLOduration=1.383678847 podStartE2EDuration="20.996465949s" totalImagesPullingTime="19.612787102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 10:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:09.996306758 +0000 UTC m=+21.774726171" watchObservedRunningTime="2026-09-06 10:22:09.996465949 +0000 UTC m=+21.774885359"
Sep 06 10:22:10.010128 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:10.010088    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal" podStartSLOduration=20.01007173 podStartE2EDuration="20.01007173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 10:21:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:10.009287796 +0000 UTC m=+21.787707211" watchObservedRunningTime="2026-09-06 10:22:10.01007173 +0000 UTC m=+21.788491143"
Sep 06 10:22:10.989111 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:10.989082    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsw6t_a4733769-37b3-443b-9ee5-d93bd5f167f0/ovn-acl-logging/0.log"
Sep 06 10:22:10.989701 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:10.989462    2561 generic.go:356] "Generic (PLEG): container finished" podID="a4733769-37b3-443b-9ee5-d93bd5f167f0" containerID="193a4212705b6c2284f7b3891b6ebed5e2ad2577944feb257b7612067096f534" exitCode=1
Sep 06 10:22:10.989701 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:10.989539    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t" event={"ID":"a4733769-37b3-443b-9ee5-d93bd5f167f0","Type":"ContainerDied","Data":"193a4212705b6c2284f7b3891b6ebed5e2ad2577944feb257b7612067096f534"}
Sep 06 10:22:10.989701 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:10.989625    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t" event={"ID":"a4733769-37b3-443b-9ee5-d93bd5f167f0","Type":"ContainerStarted","Data":"8798d91f3108c49739e67bdfb961553d230913356ae2915b5743ec8060a3b8e6"}
Sep 06 10:22:10.989701 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:10.989664    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t" event={"ID":"a4733769-37b3-443b-9ee5-d93bd5f167f0","Type":"ContainerStarted","Data":"5317796addbbdbd740114ee6564a75dca07fa68562009d91ae7671f4685ad5b1"}
Sep 06 10:22:10.989701 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:10.989700    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t" event={"ID":"a4733769-37b3-443b-9ee5-d93bd5f167f0","Type":"ContainerStarted","Data":"cdd9beb4df85e594345cb82db5b145d8d068854d01a4e4d77ccac715ece6e5ea"}
Sep 06 10:22:10.989919 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:10.989729    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t" event={"ID":"a4733769-37b3-443b-9ee5-d93bd5f167f0","Type":"ContainerStarted","Data":"923533a4676375edec7cf7f9227f6b37a43a670f897e79b4137c933ef292954f"}
Sep 06 10:22:10.991035 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:10.991012    2561 generic.go:356] "Generic (PLEG): container finished" podID="1fec0b65-b25f-4f26-9dd5-facb730de5a8" containerID="f0bc69168cc64d7aa08b5aa801413cda513e1feab3d4c3381c9ea2caa5233e01" exitCode=0
Sep 06 10:22:10.991154 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:10.991070    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6wfp" event={"ID":"1fec0b65-b25f-4f26-9dd5-facb730de5a8","Type":"ContainerDied","Data":"f0bc69168cc64d7aa08b5aa801413cda513e1feab3d4c3381c9ea2caa5233e01"}
Sep 06 10:22:10.992639 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:10.992569    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mtfnz" event={"ID":"3e728c52-da89-4425-b478-c21e3eea361a","Type":"ContainerStarted","Data":"b2cdd41712a23cc752a12df1ed702087c47aff7266bd4adc0506a44a6ca63dbc"}
Sep 06 10:22:10.994112 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:10.994092    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6" event={"ID":"58f272b6-b27a-4514-b8a9-a77b936c8cd2","Type":"ContainerStarted","Data":"7c2dfac8e5fe6320b5d0aa82c318f89a901c2c490175aceef5772c7cb888975b"}
Sep 06 10:22:10.995570 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:10.995551    2561 generic.go:356] "Generic (PLEG): container finished" podID="883f5516537eee85b2309f7c3e4b7df0" containerID="7453ee6df9a9670f6bcbeb2441f1ace1a1d7d586b19267f1f5080fc516560375" exitCode=0
Sep 06 10:22:10.995682 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:10.995617    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" event={"ID":"883f5516537eee85b2309f7c3e4b7df0","Type":"ContainerDied","Data":"7453ee6df9a9670f6bcbeb2441f1ace1a1d7d586b19267f1f5080fc516560375"}
Sep 06 10:22:10.997119 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:10.997076    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zr4w8" event={"ID":"4e601580-f2cf-423c-bf46-337104486a51","Type":"ContainerStarted","Data":"20c4c27c6fc64eef818b78572fc3ac50caf469c193af6d3d3ee67daba4818f78"}
Sep 06 10:22:10.998592 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:10.998574    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5pbf6" event={"ID":"e0afff6f-56fa-47c8-81ed-e519bde388ba","Type":"ContainerStarted","Data":"3a3e2ba5fe93e345ff54c8ed6fb2252189317a3141175e6cf5c38b8da75541b8"}
Sep 06 10:22:10.999970 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:10.999947    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fnht9" event={"ID":"f4268319-f028-4865-857a-4b453a4c42fd","Type":"ContainerStarted","Data":"33de31d39b87d78e0d211c0a635485a8dafca19ce877a53d9f7ea13eee1fac6e"}
Sep 06 10:22:11.022600 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:11.022553    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mtfnz" podStartSLOduration=2.478520942 podStartE2EDuration="22.022537882s" totalImagesPullingTime="19.54401694s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 10:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:11.022218253 +0000 UTC m=+22.800637667" watchObservedRunningTime="2026-09-06 10:22:11.022537882 +0000 UTC m=+22.800957295"
Sep 06 10:22:11.040608 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:11.040564    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zr4w8" podStartSLOduration=2.549588382 podStartE2EDuration="22.040550349s" totalImagesPullingTime="19.490961967s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 10:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:11.036574788 +0000 UTC m=+22.814994206" watchObservedRunningTime="2026-09-06 10:22:11.040550349 +0000 UTC m=+22.818969812"
Sep 06 10:22:11.050384 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:11.050346    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fnht9" podStartSLOduration=2.465927701 podStartE2EDuration="22.050332548s" totalImagesPullingTime="19.584404847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:11.050031248 +0000 UTC m=+22.828450660" watchObservedRunningTime="2026-09-06 10:22:11.050332548 +0000 UTC m=+22.828751952"
Sep 06 10:22:11.066875 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:11.066833    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5pbf6" podStartSLOduration=1.888011458 podStartE2EDuration="22.066819903s" totalImagesPullingTime="20.178808445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 10:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:11.066553284 +0000 UTC m=+22.844972697" watchObservedRunningTime="2026-09-06 10:22:11.066819903 +0000 UTC m=+22.845239315"
Sep 06 10:22:11.748034 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:11.747994    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:22:11.748034 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:11.748032    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:22:11.748292 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:11.748079    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:22:11.748292 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:11.748093    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkc66" podUID="4ff152b4-4c19-4c64-af60-41eeb9cbb81e"
Sep 06 10:22:11.748292 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:11.748155    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6prgq" podUID="705da257-7931-44ef-89b4-070ba34f4cb0"
Sep 06 10:22:11.748292 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:11.748232    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhpd" podUID="77c1dc1a-0efd-4422-842c-c630206d37a0"
Sep 06 10:22:11.952423 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:11.952389    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 06 10:22:12.004572 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:12.004479    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6" event={"ID":"58f272b6-b27a-4514-b8a9-a77b936c8cd2","Type":"ContainerStarted","Data":"511d070c770edff04cb09a12c3c978ff9b183066df9aec5021988131e31a6933"}
Sep 06 10:22:12.005976 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:12.005952    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gqm8p" event={"ID":"41e422ba-4ef6-44da-8f45-a57714ce78b8","Type":"ContainerStarted","Data":"ade02d3963d9aad484d91a5487577a13ddd33b885d18b10272eaf21119e9e4b4"}
Sep 06 10:22:12.020800 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:12.020752    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gqm8p" podStartSLOduration=3.464193633 podStartE2EDuration="23.02073804s" totalImagesPullingTime="19.556544407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 10:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:12.02015927 +0000 UTC m=+23.798578682" watchObservedRunningTime="2026-09-06 10:22:12.02073804 +0000 UTC m=+23.799157483"
Sep 06 10:22:12.695595 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:12.695310    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-06T10:22:11.952412335Z","UUID":"79b4192c-9ebe-4d52-b8a6-beb3f7e7913c","Handler":null,"Name":"","Endpoint":""}
Sep 06 10:22:12.696886 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:12.696863    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 06 10:22:12.697047 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:12.696899    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 06 10:22:13.009735 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:13.009649    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" event={"ID":"883f5516537eee85b2309f7c3e4b7df0","Type":"ContainerStarted","Data":"afa29cd93f5eb2217dcc898b164bebbdb89b7e3c5584945aa87f2c9cbf6bbe3f"}
Sep 06 10:22:13.015922 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:13.012445    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsw6t_a4733769-37b3-443b-9ee5-d93bd5f167f0/ovn-acl-logging/0.log"
Sep 06 10:22:13.015922 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:13.012709    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t" event={"ID":"a4733769-37b3-443b-9ee5-d93bd5f167f0","Type":"ContainerStarted","Data":"01f5af17840dbc841824660d322b0fc07eed7120c8a63a30a227ee78b582f8f0"}
Sep 06 10:22:13.027738 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:13.027699    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" podStartSLOduration=23.027684036 podStartE2EDuration="23.027684036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 10:21:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:13.027341003 +0000 UTC m=+24.805760407" watchObservedRunningTime="2026-09-06 10:22:13.027684036 +0000 UTC m=+24.806103505"
Sep 06 10:22:13.045467 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:13.045440    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fnht9"
Sep 06 10:22:13.046044 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:13.046025    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fnht9"
Sep 06 10:22:13.748118 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:13.748087    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:22:13.748286 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:13.748126    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:22:13.748286 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:13.748126    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:22:13.748286 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:13.748208    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkc66" podUID="4ff152b4-4c19-4c64-af60-41eeb9cbb81e"
Sep 06 10:22:13.748480 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:13.748356    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6prgq" podUID="705da257-7931-44ef-89b4-070ba34f4cb0"
Sep 06 10:22:13.748480 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:13.748446    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhpd" podUID="77c1dc1a-0efd-4422-842c-c630206d37a0"
Sep 06 10:22:14.018020 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:14.017923    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6" event={"ID":"58f272b6-b27a-4514-b8a9-a77b936c8cd2","Type":"ContainerStarted","Data":"c299d52faa2b2b98f994fa164968ec537d9378686bd4284b481b82cf82fa578f"}
Sep 06 10:22:14.018485 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:14.018084    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fnht9"
Sep 06 10:22:14.018662 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:14.018646    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fnht9"
Sep 06 10:22:14.035845 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:14.035796    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-68kb6" podStartSLOduration=2.888966608 podStartE2EDuration="25.035782012s" totalImagesPullingTime="22.146815404s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 10:21:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:14.035556607 +0000 UTC m=+25.813976020" watchObservedRunningTime="2026-09-06 10:22:14.035782012 +0000 UTC m=+25.814201426"
Sep 06 10:22:15.747917 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:15.747883    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:22:15.747917 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:15.747915    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:22:15.748435 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:15.747998    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:22:15.748435 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:15.748017    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6prgq" podUID="705da257-7931-44ef-89b4-070ba34f4cb0"
Sep 06 10:22:15.748435 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:15.748075    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhpd" podUID="77c1dc1a-0efd-4422-842c-c630206d37a0"
Sep 06 10:22:15.748435 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:15.748137    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkc66" podUID="4ff152b4-4c19-4c64-af60-41eeb9cbb81e"
Sep 06 10:22:17.027428 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:17.027241    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsw6t_a4733769-37b3-443b-9ee5-d93bd5f167f0/ovn-acl-logging/0.log"
Sep 06 10:22:17.027903 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:17.027784    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t" event={"ID":"a4733769-37b3-443b-9ee5-d93bd5f167f0","Type":"ContainerStarted","Data":"bdc9ef543286f61e55d6d6f74898fb2bca5be7ced5f081d75eadc0ccebc5aa5c"}
Sep 06 10:22:17.028018 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:17.028002    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:22:17.028206 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:17.028183    2561 scope.go:117] "RemoveContainer" containerID="193a4212705b6c2284f7b3891b6ebed5e2ad2577944feb257b7612067096f534"
Sep 06 10:22:17.029787 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:17.029766    2561 generic.go:356] "Generic (PLEG): container finished" podID="1fec0b65-b25f-4f26-9dd5-facb730de5a8" containerID="088e2079d746e97f6fd61a24e82779f444643d5c45839834fc15f2a5fcc8a1d7" exitCode=0
Sep 06 10:22:17.029888 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:17.029796    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6wfp" event={"ID":"1fec0b65-b25f-4f26-9dd5-facb730de5a8","Type":"ContainerDied","Data":"088e2079d746e97f6fd61a24e82779f444643d5c45839834fc15f2a5fcc8a1d7"}
Sep 06 10:22:17.044147 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:17.044127    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:22:17.747717 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:17.747685    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:22:17.747882 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:17.747786    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:22:17.747882 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:17.747799    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhpd" podUID="77c1dc1a-0efd-4422-842c-c630206d37a0"
Sep 06 10:22:17.747882 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:17.747815    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:22:17.748010 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:17.747883    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkc66" podUID="4ff152b4-4c19-4c64-af60-41eeb9cbb81e"
Sep 06 10:22:17.748010 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:17.747977    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6prgq" podUID="705da257-7931-44ef-89b4-070ba34f4cb0"
Sep 06 10:22:18.036621 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:18.036487    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsw6t_a4733769-37b3-443b-9ee5-d93bd5f167f0/ovn-acl-logging/0.log"
Sep 06 10:22:18.037091 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:18.036986    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t" event={"ID":"a4733769-37b3-443b-9ee5-d93bd5f167f0","Type":"ContainerStarted","Data":"057e77dd7e741ae10cc864b06e2b96293c60fb4afd86b02607a8b84fa52747df"}
Sep 06 10:22:18.037145 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:18.037108    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 06 10:22:18.037388 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:18.037365    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:22:18.059361 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:18.059342    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:22:18.064040 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:18.063905    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t" podStartSLOduration=9.545641974 podStartE2EDuration="29.063889194s" totalImagesPullingTime="19.51824722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 10:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:18.062506648 +0000 UTC m=+29.840926061" watchObservedRunningTime="2026-09-06 10:22:18.063889194 +0000 UTC m=+29.842308634"
Sep 06 10:22:18.110344 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:18.110303    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gdhpd"]
Sep 06 10:22:18.110438 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:18.110430    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:22:18.110596 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:18.110571    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhpd" podUID="77c1dc1a-0efd-4422-842c-c630206d37a0"
Sep 06 10:22:18.113763 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:18.113707    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nkc66"]
Sep 06 10:22:18.113858 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:18.113808    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:22:18.113942 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:18.113920    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkc66" podUID="4ff152b4-4c19-4c64-af60-41eeb9cbb81e"
Sep 06 10:22:18.114464 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:18.114436    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6prgq"]
Sep 06 10:22:18.114555 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:18.114531    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:22:18.114650 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:18.114632    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6prgq" podUID="705da257-7931-44ef-89b4-070ba34f4cb0"
Sep 06 10:22:19.041634 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:19.041606    2561 generic.go:356] "Generic (PLEG): container finished" podID="1fec0b65-b25f-4f26-9dd5-facb730de5a8" containerID="20cc0fbe246d89a7c68c155e54921650412a59a2b730c32113688204f62d327d" exitCode=0
Sep 06 10:22:19.041912 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:19.041688    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6wfp" event={"ID":"1fec0b65-b25f-4f26-9dd5-facb730de5a8","Type":"ContainerDied","Data":"20cc0fbe246d89a7c68c155e54921650412a59a2b730c32113688204f62d327d"}
Sep 06 10:22:19.041912 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:19.041757    2561 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 06 10:22:19.377440 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:19.377419    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:22:19.748249 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:19.748224    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:22:19.748398 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:19.748264    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:22:19.748398 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:19.748315    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:22:19.748398 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:19.748343    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6prgq" podUID="705da257-7931-44ef-89b4-070ba34f4cb0"
Sep 06 10:22:19.748527 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:19.748411    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhpd" podUID="77c1dc1a-0efd-4422-842c-c630206d37a0"
Sep 06 10:22:19.748527 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:19.748469    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkc66" podUID="4ff152b4-4c19-4c64-af60-41eeb9cbb81e"
Sep 06 10:22:20.046306 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:20.046274    2561 generic.go:356] "Generic (PLEG): container finished" podID="1fec0b65-b25f-4f26-9dd5-facb730de5a8" containerID="42da507e580605142677df7a11a335c93ef8bd13653c697a7b888fd6f7a9ffc0" exitCode=0
Sep 06 10:22:20.046664 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:20.046361    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6wfp" event={"ID":"1fec0b65-b25f-4f26-9dd5-facb730de5a8","Type":"ContainerDied","Data":"42da507e580605142677df7a11a335c93ef8bd13653c697a7b888fd6f7a9ffc0"}
Sep 06 10:22:21.060989 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:21.060963    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bsw6t"
Sep 06 10:22:21.477095 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:21.477060    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs\") pod \"network-metrics-daemon-6prgq\" (UID: \"705da257-7931-44ef-89b4-070ba34f4cb0\") " pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:22:21.477095 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:21.477097    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret\") pod \"global-pull-secret-syncer-nkc66\" (UID: \"4ff152b4-4c19-4c64-af60-41eeb9cbb81e\") " pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:22:21.477289 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:21.477199    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 10:22:21.477289 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:21.477209    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 10:22:21.477289 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:21.477260    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret podName:4ff152b4-4c19-4c64-af60-41eeb9cbb81e nodeName:}" failed. No retries permitted until 2026-09-06 10:22:53.477243513 +0000 UTC m=+65.255662905 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret") pod "global-pull-secret-syncer-nkc66" (UID: "4ff152b4-4c19-4c64-af60-41eeb9cbb81e") : object "kube-system"/"original-pull-secret" not registered
Sep 06 10:22:21.477289 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:21.477278    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs podName:705da257-7931-44ef-89b4-070ba34f4cb0 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:53.477269007 +0000 UTC m=+65.255688398 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs") pod "network-metrics-daemon-6prgq" (UID: "705da257-7931-44ef-89b4-070ba34f4cb0") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 10:22:21.578147 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:21.578118    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqpmj\" (UniqueName: \"kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj\") pod \"network-check-target-gdhpd\" (UID: \"77c1dc1a-0efd-4422-842c-c630206d37a0\") " pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:22:21.578309 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:21.578290    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 10:22:21.578365 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:21.578317    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 10:22:21.578365 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:21.578358    2561 projected.go:196] Error preparing data for projected volume kube-api-access-hqpmj for pod openshift-network-diagnostics/network-check-target-gdhpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 10:22:21.578449 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:21.578420    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj podName:77c1dc1a-0efd-4422-842c-c630206d37a0 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:53.578398387 +0000 UTC m=+65.356817782 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hqpmj" (UniqueName: "kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj") pod "network-check-target-gdhpd" (UID: "77c1dc1a-0efd-4422-842c-c630206d37a0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 10:22:21.748554 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:21.748482    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:22:21.748829 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:21.748482    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:22:21.748829 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:21.748597    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gdhpd" podUID="77c1dc1a-0efd-4422-842c-c630206d37a0"
Sep 06 10:22:21.748829 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:21.748482    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:22:21.748829 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:21.748672    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkc66" podUID="4ff152b4-4c19-4c64-af60-41eeb9cbb81e"
Sep 06 10:22:21.748829 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:21.748803    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6prgq" podUID="705da257-7931-44ef-89b4-070ba34f4cb0"
Sep 06 10:22:21.973503 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:21.973472    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeReady"
Sep 06 10:22:21.973674 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:21.973610    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 06 10:22:22.005908 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.005839    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-p77fj"]
Sep 06 10:22:22.008870 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.008844    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p77fj"
Sep 06 10:22:22.009366 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.009286    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f899d8c59-htkf6"]
Sep 06 10:22:22.011119 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.011097    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 06 10:22:22.011243 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.011100    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 06 10:22:22.011243 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.011150    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xjvkx\""
Sep 06 10:22:22.011243 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.011129    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 06 10:22:22.011574 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.011557    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 06 10:22:22.012012 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.011993    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-cs9gt"]
Sep 06 10:22:22.012117 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.012096    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.014270 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.014251    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 06 10:22:22.014390 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.014349    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 06 10:22:22.014597 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.014575    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4td26\""
Sep 06 10:22:22.014736 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.014578    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 06 10:22:22.014736 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.014638    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7px8b"]
Sep 06 10:22:22.014736 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.014831    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt"
Sep 06 10:22:22.017396 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.017377    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7px8b"
Sep 06 10:22:22.017672 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.017521    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 06 10:22:22.017672 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.017584    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bvqf7\""
Sep 06 10:22:22.017672 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.017532    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 06 10:22:22.017990 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.017978    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 06 10:22:22.018278 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.018263    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 06 10:22:22.019722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.019701    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 06 10:22:22.020556 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.020538    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 06 10:22:22.020994 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.020978    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-c22lq\""
Sep 06 10:22:22.026175 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.026151    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-p77fj"]
Sep 06 10:22:22.026553 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.026533    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-8ljwg"]
Sep 06 10:22:22.037100 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.031866    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn"]
Sep 06 10:22:22.037100 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.032738    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-8ljwg"
Sep 06 10:22:22.037100 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.032822    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 06 10:22:22.037100 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.034113    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 06 10:22:22.037100 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.035540    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fcskx"]
Sep 06 10:22:22.037100 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.035615    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 06 10:22:22.037100 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.035920    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-scjzs\""
Sep 06 10:22:22.037100 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.036085    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 06 10:22:22.037100 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.036352    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn"
Sep 06 10:22:22.038936 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.038916    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh"]
Sep 06 10:22:22.038936 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.038927    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 06 10:22:22.039304 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.039285    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fcskx"
Sep 06 10:22:22.039950 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.039928    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 06 10:22:22.040590 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.040255    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 06 10:22:22.040590 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.040440    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-slwq8\""
Sep 06 10:22:22.040590 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.040541    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 06 10:22:22.041385 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.041366    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 06 10:22:22.043826 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.041433    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9mdf5\""
Sep 06 10:22:22.043826 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.041466    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 06 10:22:22.045340 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.044960    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 06 10:22:22.045498 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.045480    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 06 10:22:22.047249 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.047196    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-66bc586b4-fkkkm"]
Sep 06 10:22:22.048235 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.047698    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh"
Sep 06 10:22:22.050301 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.049901    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 06 10:22:22.050301 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.050141    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 06 10:22:22.050512 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.050497    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bd2dz\""
Sep 06 10:22:22.051281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.051042    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 06 10:22:22.051555 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.051448    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7px8b"]
Sep 06 10:22:22.051555 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.051482    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f899d8c59-htkf6"]
Sep 06 10:22:22.051555 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.051504    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-cs9gt"]
Sep 06 10:22:22.051555 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.051523    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fcskx"]
Sep 06 10:22:22.051555 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.051545    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h5mgn"]
Sep 06 10:22:22.051915 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.051866    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:22.054417 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.054388    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 06 10:22:22.054493 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.054431    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 06 10:22:22.054818 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.054571    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 06 10:22:22.054818 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.054631    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 06 10:22:22.054818 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.054653    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 06 10:22:22.054818 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.054675    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-k75fj\""
Sep 06 10:22:22.055066 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.054874    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 06 10:22:22.055178 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.055160    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-zp6cg"]
Sep 06 10:22:22.055267 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.055245    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h5mgn"
Sep 06 10:22:22.058069 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.058039    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zzn8f"]
Sep 06 10:22:22.058954 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.058937    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5f7rv\""
Sep 06 10:22:22.059221 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.059202    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 06 10:22:22.059441 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.059418    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 06 10:22:22.059668 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.059642    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-zp6cg"
Sep 06 10:22:22.059818 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.059797    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 06 10:22:22.062036 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.061696    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 06 10:22:22.062036 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.061744    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-fgtkf"]
Sep 06 10:22:22.062036 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.062016    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 06 10:22:22.062543 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.062209    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-dfk62\""
Sep 06 10:22:22.062543 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.062281    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:22:22.065413 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.065391    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mhwb9\""
Sep 06 10:22:22.066558 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.066541    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 06 10:22:22.069360 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.069339    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 06 10:22:22.069505 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.069483    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-66bc586b4-fkkkm"]
Sep 06 10:22:22.069566 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.069532    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn"]
Sep 06 10:22:22.069566 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.069558    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-8ljwg"]
Sep 06 10:22:22.069660 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.069586    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-zp6cg"]
Sep 06 10:22:22.069660 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.069609    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h5mgn"]
Sep 06 10:22:22.069765 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.069691    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-fgtkf"
Sep 06 10:22:22.069881 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.069864    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zzn8f"]
Sep 06 10:22:22.069934 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.069918    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-fgtkf"]
Sep 06 10:22:22.069981 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.069944    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh"]
Sep 06 10:22:22.071854 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.071833    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 06 10:22:22.072027 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.071988    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 06 10:22:22.072677 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.072659    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-l7zlz\""
Sep 06 10:22:22.072775 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.072705    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 06 10:22:22.072852 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.072816    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 06 10:22:22.077417 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.077386    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 06 10:22:22.081640 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.081617    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.081759 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.081738    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5bcfaad-879c-4173-816a-63ddf0252bec-installation-pull-secrets\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.082014 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.081994    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xvmq\" (UniqueName: \"kubernetes.io/projected/8a2b85b1-450b-453c-a0a4-057de1690742-kube-api-access-5xvmq\") pod \"service-ca-operator-859f94c4b-p77fj\" (UID: \"8a2b85b1-450b-453c-a0a4-057de1690742\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p77fj"
Sep 06 10:22:22.082088 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082026    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3c63327-812e-4353-903f-2ad8d3a5b31f-serving-cert\") pod \"insights-operator-76bcd6ccf5-cs9gt\" (UID: \"c3c63327-812e-4353-903f-2ad8d3a5b31f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt"
Sep 06 10:22:22.082088 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082053    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-certificates\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.082088 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082076    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3c63327-812e-4353-903f-2ad8d3a5b31f-tmp\") pod \"insights-operator-76bcd6ccf5-cs9gt\" (UID: \"c3c63327-812e-4353-903f-2ad8d3a5b31f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt"
Sep 06 10:22:22.082235 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082102    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c63327-812e-4353-903f-2ad8d3a5b31f-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-cs9gt\" (UID: \"c3c63327-812e-4353-903f-2ad8d3a5b31f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt"
Sep 06 10:22:22.082235 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082127    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffbsm\" (UniqueName: \"kubernetes.io/projected/c3c63327-812e-4353-903f-2ad8d3a5b31f-kube-api-access-ffbsm\") pod \"insights-operator-76bcd6ccf5-cs9gt\" (UID: \"c3c63327-812e-4353-903f-2ad8d3a5b31f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt"
Sep 06 10:22:22.082235 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082151    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spmsk\" (UniqueName: \"kubernetes.io/projected/5a7404c4-4386-4f2d-aa64-ea0622b6d073-kube-api-access-spmsk\") pod \"cluster-monitoring-operator-6cdcc96965-jpxdn\" (UID: \"5a7404c4-4386-4f2d-aa64-ea0622b6d073\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn"
Sep 06 10:22:22.082235 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082175    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chbxx\" (UniqueName: \"kubernetes.io/projected/dbf09546-a6d3-4b10-900a-0940b9c2794e-kube-api-access-chbxx\") pod \"volume-data-source-validator-695c895bd6-7px8b\" (UID: \"dbf09546-a6d3-4b10-900a-0940b9c2794e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7px8b"
Sep 06 10:22:22.082235 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082205    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n74x5\" (UniqueName: \"kubernetes.io/projected/e20c6a2b-e419-4124-884a-b60dac26955d-kube-api-access-n74x5\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fcskx\" (UID: \"e20c6a2b-e419-4124-884a-b60dac26955d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fcskx"
Sep 06 10:22:22.082506 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082244    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jpxdn\" (UID: \"5a7404c4-4386-4f2d-aa64-ea0622b6d073\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn"
Sep 06 10:22:22.082506 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082340    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-nginx-conf\") pod \"networking-console-plugin-79977f9844-8ljwg\" (UID: \"4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8ljwg"
Sep 06 10:22:22.082506 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082369    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e20c6a2b-e419-4124-884a-b60dac26955d-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fcskx\" (UID: \"e20c6a2b-e419-4124-884a-b60dac26955d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fcskx"
Sep 06 10:22:22.082506 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082415    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e20c6a2b-e419-4124-884a-b60dac26955d-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fcskx\" (UID: \"e20c6a2b-e419-4124-884a-b60dac26955d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fcskx"
Sep 06 10:22:22.082506 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082461    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c3c63327-812e-4353-903f-2ad8d3a5b31f-snapshots\") pod \"insights-operator-76bcd6ccf5-cs9gt\" (UID: \"c3c63327-812e-4353-903f-2ad8d3a5b31f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt"
Sep 06 10:22:22.082506 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082484    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c63327-812e-4353-903f-2ad8d3a5b31f-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-cs9gt\" (UID: \"c3c63327-812e-4353-903f-2ad8d3a5b31f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt"
Sep 06 10:22:22.082886 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082507    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5a7404c4-4386-4f2d-aa64-ea0622b6d073-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-jpxdn\" (UID: \"5a7404c4-4386-4f2d-aa64-ea0622b6d073\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn"
Sep 06 10:22:22.082886 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082537    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a2b85b1-450b-453c-a0a4-057de1690742-config\") pod \"service-ca-operator-859f94c4b-p77fj\" (UID: \"8a2b85b1-450b-453c-a0a4-057de1690742\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p77fj"
Sep 06 10:22:22.082886 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082558    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5bcfaad-879c-4173-816a-63ddf0252bec-trusted-ca\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.082886 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082589    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a2b85b1-450b-453c-a0a4-057de1690742-serving-cert\") pod \"service-ca-operator-859f94c4b-p77fj\" (UID: \"8a2b85b1-450b-453c-a0a4-057de1690742\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p77fj"
Sep 06 10:22:22.082886 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082640    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz6vm\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-kube-api-access-zz6vm\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.082886 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082670    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5bcfaad-879c-4173-816a-63ddf0252bec-ca-trust-extracted\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.082886 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082694    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-bound-sa-token\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.082886 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082720    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-8ljwg\" (UID: \"4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8ljwg"
Sep 06 10:22:22.082886 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.082753    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5bcfaad-879c-4173-816a-63ddf0252bec-image-registry-private-configuration\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.183083 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183051    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-stats-auth\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:22.183083 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183087    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-c4fdh\" (UID: \"f8e77ae8-b076-4ca5-9c4a-e433e6fac236\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh"
Sep 06 10:22:22.183303 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183107    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwxbn\" (UniqueName: \"kubernetes.io/projected/30979a9f-a090-4ced-a423-0f091a73a801-kube-api-access-vwxbn\") pod \"ingress-canary-h5mgn\" (UID: \"30979a9f-a090-4ced-a423-0f091a73a801\") " pod="openshift-ingress-canary/ingress-canary-h5mgn"
Sep 06 10:22:22.183303 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183180    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n48zm\" (UniqueName: \"kubernetes.io/projected/dfee3641-093e-47c4-bb89-51a039ac335c-kube-api-access-n48zm\") pod \"console-operator-85b454874b-fgtkf\" (UID: \"dfee3641-093e-47c4-bb89-51a039ac335c\") " pod="openshift-console-operator/console-operator-85b454874b-fgtkf"
Sep 06 10:22:22.183303 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183219    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls\") pod \"dns-default-zzn8f\" (UID: \"f9689b0e-8830-4c94-befb-3c64ef549feb\") " pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:22:22.183303 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183239    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a2b85b1-450b-453c-a0a4-057de1690742-serving-cert\") pod \"service-ca-operator-859f94c4b-p77fj\" (UID: \"8a2b85b1-450b-453c-a0a4-057de1690742\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p77fj"
Sep 06 10:22:22.183303 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183260    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz6vm\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-kube-api-access-zz6vm\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.183303 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183290    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-8ljwg\" (UID: \"4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8ljwg"
Sep 06 10:22:22.183631 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.183389    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 10:22:22.183631 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.183463    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert podName:4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:22.683442961 +0000 UTC m=+34.461862365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-8ljwg" (UID: "4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822") : secret "networking-console-plugin-cert" not found
Sep 06 10:22:22.183631 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183490    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5bcfaad-879c-4173-816a-63ddf0252bec-ca-trust-extracted\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.183631 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-bound-sa-token\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.183631 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183566    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5bcfaad-879c-4173-816a-63ddf0252bec-image-registry-private-configuration\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.183631 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183589    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5bcfaad-879c-4173-816a-63ddf0252bec-installation-pull-secrets\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.183631 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183607    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3c63327-812e-4353-903f-2ad8d3a5b31f-tmp\") pod \"insights-operator-76bcd6ccf5-cs9gt\" (UID: \"c3c63327-812e-4353-903f-2ad8d3a5b31f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt"
Sep 06 10:22:22.183631 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183629    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chbxx\" (UniqueName: \"kubernetes.io/projected/dbf09546-a6d3-4b10-900a-0940b9c2794e-kube-api-access-chbxx\") pod \"volume-data-source-validator-695c895bd6-7px8b\" (UID: \"dbf09546-a6d3-4b10-900a-0940b9c2794e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7px8b"
Sep 06 10:22:22.183926 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183657    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9689b0e-8830-4c94-befb-3c64ef549feb-tmp-dir\") pod \"dns-default-zzn8f\" (UID: \"f9689b0e-8830-4c94-befb-3c64ef549feb\") " pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:22:22.183926 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183682    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xvmq\" (UniqueName: \"kubernetes.io/projected/8a2b85b1-450b-453c-a0a4-057de1690742-kube-api-access-5xvmq\") pod \"service-ca-operator-859f94c4b-p77fj\" (UID: \"8a2b85b1-450b-453c-a0a4-057de1690742\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p77fj"
Sep 06 10:22:22.183926 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183708    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-certificates\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.183926 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183729    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffbsm\" (UniqueName: \"kubernetes.io/projected/c3c63327-812e-4353-903f-2ad8d3a5b31f-kube-api-access-ffbsm\") pod \"insights-operator-76bcd6ccf5-cs9gt\" (UID: \"c3c63327-812e-4353-903f-2ad8d3a5b31f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt"
Sep 06 10:22:22.183926 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183748    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spmsk\" (UniqueName: \"kubernetes.io/projected/5a7404c4-4386-4f2d-aa64-ea0622b6d073-kube-api-access-spmsk\") pod \"cluster-monitoring-operator-6cdcc96965-jpxdn\" (UID: \"5a7404c4-4386-4f2d-aa64-ea0622b6d073\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn"
Sep 06 10:22:22.183926 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183770    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-nginx-conf\") pod \"networking-console-plugin-79977f9844-8ljwg\" (UID: \"4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8ljwg"
Sep 06 10:22:22.183926 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183805    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c63327-812e-4353-903f-2ad8d3a5b31f-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-cs9gt\" (UID: \"c3c63327-812e-4353-903f-2ad8d3a5b31f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt"
Sep 06 10:22:22.183926 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183832    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n74x5\" (UniqueName: \"kubernetes.io/projected/e20c6a2b-e419-4124-884a-b60dac26955d-kube-api-access-n74x5\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fcskx\" (UID: \"e20c6a2b-e419-4124-884a-b60dac26955d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fcskx"
Sep 06 10:22:22.183926 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183852    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30979a9f-a090-4ced-a423-0f091a73a801-cert\") pod \"ingress-canary-h5mgn\" (UID: \"30979a9f-a090-4ced-a423-0f091a73a801\") " pod="openshift-ingress-canary/ingress-canary-h5mgn"
Sep 06 10:22:22.183926 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183901    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jpxdn\" (UID: \"5a7404c4-4386-4f2d-aa64-ea0622b6d073\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn"
Sep 06 10:22:22.183926 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183923    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfee3641-093e-47c4-bb89-51a039ac335c-trusted-ca\") pod \"console-operator-85b454874b-fgtkf\" (UID: \"dfee3641-093e-47c4-bb89-51a039ac335c\") " pod="openshift-console-operator/console-operator-85b454874b-fgtkf"
Sep 06 10:22:22.184417 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183963    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:22.184417 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.183995    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl4gr\" (UniqueName: \"kubernetes.io/projected/a6a44bba-f648-42d6-8865-98df551742f6-kube-api-access-fl4gr\") pod \"network-check-source-685456655f-zp6cg\" (UID: \"a6a44bba-f648-42d6-8865-98df551742f6\") " pod="openshift-network-diagnostics/network-check-source-685456655f-zp6cg"
Sep 06 10:22:22.184417 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.184055    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e20c6a2b-e419-4124-884a-b60dac26955d-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fcskx\" (UID: \"e20c6a2b-e419-4124-884a-b60dac26955d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fcskx"
Sep 06 10:22:22.184417 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.184079    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frptv\" (UniqueName: \"kubernetes.io/projected/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-kube-api-access-frptv\") pod \"cluster-samples-operator-7cdcfcf76c-c4fdh\" (UID: \"f8e77ae8-b076-4ca5-9c4a-e433e6fac236\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh"
Sep 06 10:22:22.184417 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.184107    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-default-certificate\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:22.184417 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.184163    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c3c63327-812e-4353-903f-2ad8d3a5b31f-snapshots\") pod \"insights-operator-76bcd6ccf5-cs9gt\" (UID: \"c3c63327-812e-4353-903f-2ad8d3a5b31f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt"
Sep 06 10:22:22.184417 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.184181    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5bcfaad-879c-4173-816a-63ddf0252bec-ca-trust-extracted\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.184778 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.184571    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3c63327-812e-4353-903f-2ad8d3a5b31f-tmp\") pod \"insights-operator-76bcd6ccf5-cs9gt\" (UID: \"c3c63327-812e-4353-903f-2ad8d3a5b31f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt"
Sep 06 10:22:22.185291 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.184866    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-nginx-conf\") pod \"networking-console-plugin-79977f9844-8ljwg\" (UID: \"4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8ljwg"
Sep 06 10:22:22.185709 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.185562    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 10:22:22.185815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.185709    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e20c6a2b-e419-4124-884a-b60dac26955d-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fcskx\" (UID: \"e20c6a2b-e419-4124-884a-b60dac26955d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fcskx"
Sep 06 10:22:22.185815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.184186    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c63327-812e-4353-903f-2ad8d3a5b31f-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-cs9gt\" (UID: \"c3c63327-812e-4353-903f-2ad8d3a5b31f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt"
Sep 06 10:22:22.185815 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.185762    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls podName:5a7404c4-4386-4f2d-aa64-ea0622b6d073 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:22.685742959 +0000 UTC m=+34.464162367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jpxdn" (UID: "5a7404c4-4386-4f2d-aa64-ea0622b6d073") : secret "cluster-monitoring-operator-tls" not found
Sep 06 10:22:22.185815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.185795    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:22.186023 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.185822    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5a7404c4-4386-4f2d-aa64-ea0622b6d073-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-jpxdn\" (UID: \"5a7404c4-4386-4f2d-aa64-ea0622b6d073\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn"
Sep 06 10:22:22.186023 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.185846    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rstbc\" (UniqueName: \"kubernetes.io/projected/f9689b0e-8830-4c94-befb-3c64ef549feb-kube-api-access-rstbc\") pod \"dns-default-zzn8f\" (UID: \"f9689b0e-8830-4c94-befb-3c64ef549feb\") " pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:22:22.186023 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.185867    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frjj9\" (UniqueName: \"kubernetes.io/projected/1056410a-6c66-44ab-b62e-8e2046b73703-kube-api-access-frjj9\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:22.186023 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.185891    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a2b85b1-450b-453c-a0a4-057de1690742-config\") pod \"service-ca-operator-859f94c4b-p77fj\" (UID: \"8a2b85b1-450b-453c-a0a4-057de1690742\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p77fj"
Sep 06 10:22:22.186023 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.185907    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c63327-812e-4353-903f-2ad8d3a5b31f-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-cs9gt\" (UID: \"c3c63327-812e-4353-903f-2ad8d3a5b31f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt"
Sep 06 10:22:22.186023 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.185911    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5bcfaad-879c-4173-816a-63ddf0252bec-trusted-ca\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.186023 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.185962    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e20c6a2b-e419-4124-884a-b60dac26955d-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fcskx\" (UID: \"e20c6a2b-e419-4124-884a-b60dac26955d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fcskx"
Sep 06 10:22:22.186023 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.186002    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dfee3641-093e-47c4-bb89-51a039ac335c-serving-cert\") pod \"console-operator-85b454874b-fgtkf\" (UID: \"dfee3641-093e-47c4-bb89-51a039ac335c\") " pod="openshift-console-operator/console-operator-85b454874b-fgtkf"
Sep 06 10:22:22.186452 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.186079    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.186452 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.186104    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dfee3641-093e-47c4-bb89-51a039ac335c-config\") pod \"console-operator-85b454874b-fgtkf\" (UID: \"dfee3641-093e-47c4-bb89-51a039ac335c\") " pod="openshift-console-operator/console-operator-85b454874b-fgtkf"
Sep 06 10:22:22.186452 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.186142    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3c63327-812e-4353-903f-2ad8d3a5b31f-serving-cert\") pod \"insights-operator-76bcd6ccf5-cs9gt\" (UID: \"c3c63327-812e-4353-903f-2ad8d3a5b31f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt"
Sep 06 10:22:22.186452 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.186151    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c3c63327-812e-4353-903f-2ad8d3a5b31f-snapshots\") pod \"insights-operator-76bcd6ccf5-cs9gt\" (UID: \"c3c63327-812e-4353-903f-2ad8d3a5b31f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt"
Sep 06 10:22:22.186452 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.186169    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9689b0e-8830-4c94-befb-3c64ef549feb-config-volume\") pod \"dns-default-zzn8f\" (UID: \"f9689b0e-8830-4c94-befb-3c64ef549feb\") " pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:22:22.187226 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.186735    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a2b85b1-450b-453c-a0a4-057de1690742-config\") pod \"service-ca-operator-859f94c4b-p77fj\" (UID: \"8a2b85b1-450b-453c-a0a4-057de1690742\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p77fj"
Sep 06 10:22:22.187226 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.186826    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 10:22:22.187226 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.186839    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f899d8c59-htkf6: secret "image-registry-tls" not found
Sep 06 10:22:22.187226 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.186846    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5bcfaad-879c-4173-816a-63ddf0252bec-trusted-ca\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.187226 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.186884    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls podName:d5bcfaad-879c-4173-816a-63ddf0252bec nodeName:}" failed. No retries permitted until 2026-09-06 10:22:22.686869509 +0000 UTC m=+34.465288910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls") pod "image-registry-6f899d8c59-htkf6" (UID: "d5bcfaad-879c-4173-816a-63ddf0252bec") : secret "image-registry-tls" not found
Sep 06 10:22:22.187226 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.187181    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c63327-812e-4353-903f-2ad8d3a5b31f-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-cs9gt\" (UID: \"c3c63327-812e-4353-903f-2ad8d3a5b31f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt"
Sep 06 10:22:22.187657 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.187308    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-certificates\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.188233 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.188207    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5a7404c4-4386-4f2d-aa64-ea0622b6d073-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-jpxdn\" (UID: \"5a7404c4-4386-4f2d-aa64-ea0622b6d073\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn"
Sep 06 10:22:22.188436 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.188414    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a2b85b1-450b-453c-a0a4-057de1690742-serving-cert\") pod \"service-ca-operator-859f94c4b-p77fj\" (UID: \"8a2b85b1-450b-453c-a0a4-057de1690742\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p77fj"
Sep 06 10:22:22.188608 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.188575    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5bcfaad-879c-4173-816a-63ddf0252bec-installation-pull-secrets\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.188690 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.188582    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5bcfaad-879c-4173-816a-63ddf0252bec-image-registry-private-configuration\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.188900 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.188879    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e20c6a2b-e419-4124-884a-b60dac26955d-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fcskx\" (UID: \"e20c6a2b-e419-4124-884a-b60dac26955d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fcskx"
Sep 06 10:22:22.189875 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.189858    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3c63327-812e-4353-903f-2ad8d3a5b31f-serving-cert\") pod \"insights-operator-76bcd6ccf5-cs9gt\" (UID: \"c3c63327-812e-4353-903f-2ad8d3a5b31f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt"
Sep 06 10:22:22.193022 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.192972    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xvmq\" (UniqueName: \"kubernetes.io/projected/8a2b85b1-450b-453c-a0a4-057de1690742-kube-api-access-5xvmq\") pod \"service-ca-operator-859f94c4b-p77fj\" (UID: \"8a2b85b1-450b-453c-a0a4-057de1690742\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p77fj"
Sep 06 10:22:22.193599 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.193565    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chbxx\" (UniqueName: \"kubernetes.io/projected/dbf09546-a6d3-4b10-900a-0940b9c2794e-kube-api-access-chbxx\") pod \"volume-data-source-validator-695c895bd6-7px8b\" (UID: \"dbf09546-a6d3-4b10-900a-0940b9c2794e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7px8b"
Sep 06 10:22:22.193859 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.193817    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-bound-sa-token\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.194667 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.194592    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz6vm\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-kube-api-access-zz6vm\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.194831 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.194811    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spmsk\" (UniqueName: \"kubernetes.io/projected/5a7404c4-4386-4f2d-aa64-ea0622b6d073-kube-api-access-spmsk\") pod \"cluster-monitoring-operator-6cdcc96965-jpxdn\" (UID: \"5a7404c4-4386-4f2d-aa64-ea0622b6d073\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn"
Sep 06 10:22:22.194935 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.194914    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n74x5\" (UniqueName: \"kubernetes.io/projected/e20c6a2b-e419-4124-884a-b60dac26955d-kube-api-access-n74x5\") pod \"kube-storage-version-migrator-operator-8d7dd4675-fcskx\" (UID: \"e20c6a2b-e419-4124-884a-b60dac26955d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fcskx"
Sep 06 10:22:22.195467 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.195450    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffbsm\" (UniqueName: \"kubernetes.io/projected/c3c63327-812e-4353-903f-2ad8d3a5b31f-kube-api-access-ffbsm\") pod \"insights-operator-76bcd6ccf5-cs9gt\" (UID: \"c3c63327-812e-4353-903f-2ad8d3a5b31f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt"
Sep 06 10:22:22.286742 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.286666    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-c4fdh\" (UID: \"f8e77ae8-b076-4ca5-9c4a-e433e6fac236\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh"
Sep 06 10:22:22.286742 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.286705    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwxbn\" (UniqueName: \"kubernetes.io/projected/30979a9f-a090-4ced-a423-0f091a73a801-kube-api-access-vwxbn\") pod \"ingress-canary-h5mgn\" (UID: \"30979a9f-a090-4ced-a423-0f091a73a801\") " pod="openshift-ingress-canary/ingress-canary-h5mgn"
Sep 06 10:22:22.286742 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.286736    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n48zm\" (UniqueName: \"kubernetes.io/projected/dfee3641-093e-47c4-bb89-51a039ac335c-kube-api-access-n48zm\") pod \"console-operator-85b454874b-fgtkf\" (UID: \"dfee3641-093e-47c4-bb89-51a039ac335c\") " pod="openshift-console-operator/console-operator-85b454874b-fgtkf"
Sep 06 10:22:22.287180 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.286775    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls\") pod \"dns-default-zzn8f\" (UID: \"f9689b0e-8830-4c94-befb-3c64ef549feb\") " pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:22:22.287180 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.286813    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 10:22:22.287180 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.286880    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls podName:f8e77ae8-b076-4ca5-9c4a-e433e6fac236 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:22.786861657 +0000 UTC m=+34.565281062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-c4fdh" (UID: "f8e77ae8-b076-4ca5-9c4a-e433e6fac236") : secret "samples-operator-tls" not found
Sep 06 10:22:22.287180 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.286918    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9689b0e-8830-4c94-befb-3c64ef549feb-tmp-dir\") pod \"dns-default-zzn8f\" (UID: \"f9689b0e-8830-4c94-befb-3c64ef549feb\") " pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:22:22.287180 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.286934    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 10:22:22.287180 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.286960    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30979a9f-a090-4ced-a423-0f091a73a801-cert\") pod \"ingress-canary-h5mgn\" (UID: \"30979a9f-a090-4ced-a423-0f091a73a801\") " pod="openshift-ingress-canary/ingress-canary-h5mgn"
Sep 06 10:22:22.287180 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.287013    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls podName:f9689b0e-8830-4c94-befb-3c64ef549feb nodeName:}" failed. No retries permitted until 2026-09-06 10:22:22.787000292 +0000 UTC m=+34.565419699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls") pod "dns-default-zzn8f" (UID: "f9689b0e-8830-4c94-befb-3c64ef549feb") : secret "dns-default-metrics-tls" not found
Sep 06 10:22:22.287180 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.287030    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfee3641-093e-47c4-bb89-51a039ac335c-trusted-ca\") pod \"console-operator-85b454874b-fgtkf\" (UID: \"dfee3641-093e-47c4-bb89-51a039ac335c\") " pod="openshift-console-operator/console-operator-85b454874b-fgtkf"
Sep 06 10:22:22.287180 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.287057    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:22.287759 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.287391    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9689b0e-8830-4c94-befb-3c64ef549feb-tmp-dir\") pod \"dns-default-zzn8f\" (UID: \"f9689b0e-8830-4c94-befb-3c64ef549feb\") " pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:22:22.287759 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.287443    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl4gr\" (UniqueName: \"kubernetes.io/projected/a6a44bba-f648-42d6-8865-98df551742f6-kube-api-access-fl4gr\") pod \"network-check-source-685456655f-zp6cg\" (UID: \"a6a44bba-f648-42d6-8865-98df551742f6\") " pod="openshift-network-diagnostics/network-check-source-685456655f-zp6cg"
Sep 06 10:22:22.287759 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.287481    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle podName:1056410a-6c66-44ab-b62e-8e2046b73703 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:22.787458456 +0000 UTC m=+34.565877850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle") pod "router-default-66bc586b4-fkkkm" (UID: "1056410a-6c66-44ab-b62e-8e2046b73703") : configmap references non-existent config key: service-ca.crt
Sep 06 10:22:22.287759 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.287545    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frptv\" (UniqueName: \"kubernetes.io/projected/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-kube-api-access-frptv\") pod \"cluster-samples-operator-7cdcfcf76c-c4fdh\" (UID: \"f8e77ae8-b076-4ca5-9c4a-e433e6fac236\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh"
Sep 06 10:22:22.287759 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.287574    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-default-certificate\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:22.287759 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.287602    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:22.287759 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.287629    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rstbc\" (UniqueName: \"kubernetes.io/projected/f9689b0e-8830-4c94-befb-3c64ef549feb-kube-api-access-rstbc\") pod \"dns-default-zzn8f\" (UID: \"f9689b0e-8830-4c94-befb-3c64ef549feb\") " pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:22:22.287759 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.287662    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frjj9\" (UniqueName: \"kubernetes.io/projected/1056410a-6c66-44ab-b62e-8e2046b73703-kube-api-access-frjj9\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:22.287759 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.287695    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dfee3641-093e-47c4-bb89-51a039ac335c-serving-cert\") pod \"console-operator-85b454874b-fgtkf\" (UID: \"dfee3641-093e-47c4-bb89-51a039ac335c\") " pod="openshift-console-operator/console-operator-85b454874b-fgtkf"
Sep 06 10:22:22.287759 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.287742    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dfee3641-093e-47c4-bb89-51a039ac335c-config\") pod \"console-operator-85b454874b-fgtkf\" (UID: \"dfee3641-093e-47c4-bb89-51a039ac335c\") " pod="openshift-console-operator/console-operator-85b454874b-fgtkf"
Sep 06 10:22:22.288420 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.287773    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9689b0e-8830-4c94-befb-3c64ef549feb-config-volume\") pod \"dns-default-zzn8f\" (UID: \"f9689b0e-8830-4c94-befb-3c64ef549feb\") " pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:22:22.288420 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.287800    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-stats-auth\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:22.288420 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.288214    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 10:22:22.288420 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.288259    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs podName:1056410a-6c66-44ab-b62e-8e2046b73703 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:22.78824516 +0000 UTC m=+34.566664569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs") pod "router-default-66bc586b4-fkkkm" (UID: "1056410a-6c66-44ab-b62e-8e2046b73703") : secret "router-metrics-certs-default" not found
Sep 06 10:22:22.288420 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.288405    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfee3641-093e-47c4-bb89-51a039ac335c-trusted-ca\") pod \"console-operator-85b454874b-fgtkf\" (UID: \"dfee3641-093e-47c4-bb89-51a039ac335c\") " pod="openshift-console-operator/console-operator-85b454874b-fgtkf"
Sep 06 10:22:22.288840 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.288818    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/dfee3641-093e-47c4-bb89-51a039ac335c-config\") pod \"console-operator-85b454874b-fgtkf\" (UID: \"dfee3641-093e-47c4-bb89-51a039ac335c\") " pod="openshift-console-operator/console-operator-85b454874b-fgtkf"
Sep 06 10:22:22.289645 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.289625    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9689b0e-8830-4c94-befb-3c64ef549feb-config-volume\") pod \"dns-default-zzn8f\" (UID: \"f9689b0e-8830-4c94-befb-3c64ef549feb\") " pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:22:22.290474 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.290455    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dfee3641-093e-47c4-bb89-51a039ac335c-serving-cert\") pod \"console-operator-85b454874b-fgtkf\" (UID: \"dfee3641-093e-47c4-bb89-51a039ac335c\") " pod="openshift-console-operator/console-operator-85b454874b-fgtkf"
Sep 06 10:22:22.290938 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.290918    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-default-certificate\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:22.290995 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.290927    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/30979a9f-a090-4ced-a423-0f091a73a801-cert\") pod \"ingress-canary-h5mgn\" (UID: \"30979a9f-a090-4ced-a423-0f091a73a801\") " pod="openshift-ingress-canary/ingress-canary-h5mgn"
Sep 06 10:22:22.291505 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.291480    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-stats-auth\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:22.298354 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.298293    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl4gr\" (UniqueName: \"kubernetes.io/projected/a6a44bba-f648-42d6-8865-98df551742f6-kube-api-access-fl4gr\") pod \"network-check-source-685456655f-zp6cg\" (UID: \"a6a44bba-f648-42d6-8865-98df551742f6\") " pod="openshift-network-diagnostics/network-check-source-685456655f-zp6cg"
Sep 06 10:22:22.299193 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.298968    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n48zm\" (UniqueName: \"kubernetes.io/projected/dfee3641-093e-47c4-bb89-51a039ac335c-kube-api-access-n48zm\") pod \"console-operator-85b454874b-fgtkf\" (UID: \"dfee3641-093e-47c4-bb89-51a039ac335c\") " pod="openshift-console-operator/console-operator-85b454874b-fgtkf"
Sep 06 10:22:22.299193 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.299052    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwxbn\" (UniqueName: \"kubernetes.io/projected/30979a9f-a090-4ced-a423-0f091a73a801-kube-api-access-vwxbn\") pod \"ingress-canary-h5mgn\" (UID: \"30979a9f-a090-4ced-a423-0f091a73a801\") " pod="openshift-ingress-canary/ingress-canary-h5mgn"
Sep 06 10:22:22.299552 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.299532    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frptv\" (UniqueName: \"kubernetes.io/projected/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-kube-api-access-frptv\") pod \"cluster-samples-operator-7cdcfcf76c-c4fdh\" (UID: \"f8e77ae8-b076-4ca5-9c4a-e433e6fac236\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh"
Sep 06 10:22:22.299803 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.299783    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rstbc\" (UniqueName: \"kubernetes.io/projected/f9689b0e-8830-4c94-befb-3c64ef549feb-kube-api-access-rstbc\") pod \"dns-default-zzn8f\" (UID: \"f9689b0e-8830-4c94-befb-3c64ef549feb\") " pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:22:22.300308 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.300289    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frjj9\" (UniqueName: \"kubernetes.io/projected/1056410a-6c66-44ab-b62e-8e2046b73703-kube-api-access-frjj9\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:22.319196 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.319174    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p77fj"
Sep 06 10:22:22.344845 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.344821    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt"
Sep 06 10:22:22.359374 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.359348    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7px8b"
Sep 06 10:22:22.386313 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.386198    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fcskx"
Sep 06 10:22:22.410274 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.410251    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h5mgn"
Sep 06 10:22:22.416385 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.415942    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-zp6cg"
Sep 06 10:22:22.429406 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.429372    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-fgtkf"
Sep 06 10:22:22.618445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.618413    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-p77fj"]
Sep 06 10:22:22.621985 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:22:22.621952    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a2b85b1_450b_453c_a0a4_057de1690742.slice/crio-051d9f7ad56fb90bc98d67c2d9c0971e25ca6cbdad1f2cd491bc2411ddaced9a WatchSource:0}: Error finding container 051d9f7ad56fb90bc98d67c2d9c0971e25ca6cbdad1f2cd491bc2411ddaced9a: Status 404 returned error can't find the container with id 051d9f7ad56fb90bc98d67c2d9c0971e25ca6cbdad1f2cd491bc2411ddaced9a
Sep 06 10:22:22.635272 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.635240    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-cs9gt"]
Sep 06 10:22:22.638670 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:22:22.638637    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c63327_812e_4353_903f_2ad8d3a5b31f.slice/crio-d49e370818bf031477e4bfe2315c745c899273eec4c87d5f26f53b7b8538c33f WatchSource:0}: Error finding container d49e370818bf031477e4bfe2315c745c899273eec4c87d5f26f53b7b8538c33f: Status 404 returned error can't find the container with id d49e370818bf031477e4bfe2315c745c899273eec4c87d5f26f53b7b8538c33f
Sep 06 10:22:22.655561 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.655538    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7px8b"]
Sep 06 10:22:22.657732 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:22:22.657704    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf09546_a6d3_4b10_900a_0940b9c2794e.slice/crio-fa4ca88a58e9e70fb389f6041dd1ed78be9ee9d1a1b5f55f37defcfde0dd2828 WatchSource:0}: Error finding container fa4ca88a58e9e70fb389f6041dd1ed78be9ee9d1a1b5f55f37defcfde0dd2828: Status 404 returned error can't find the container with id fa4ca88a58e9e70fb389f6041dd1ed78be9ee9d1a1b5f55f37defcfde0dd2828
Sep 06 10:22:22.692311 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.692285    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-8ljwg\" (UID: \"4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8ljwg"
Sep 06 10:22:22.692492 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.692376    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jpxdn\" (UID: \"5a7404c4-4386-4f2d-aa64-ea0622b6d073\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn"
Sep 06 10:22:22.692492 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.692436    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 10:22:22.692492 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.692470    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:22.692492 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.692479    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 10:22:22.692709 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.692505    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert podName:4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:23.692485327 +0000 UTC m=+35.470904729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-8ljwg" (UID: "4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822") : secret "networking-console-plugin-cert" not found
Sep 06 10:22:22.692709 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.692527    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls podName:5a7404c4-4386-4f2d-aa64-ea0622b6d073 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:23.692515953 +0000 UTC m=+35.470935357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jpxdn" (UID: "5a7404c4-4386-4f2d-aa64-ea0622b6d073") : secret "cluster-monitoring-operator-tls" not found
Sep 06 10:22:22.692709 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.692560    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 10:22:22.692709 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.692573    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f899d8c59-htkf6: secret "image-registry-tls" not found
Sep 06 10:22:22.692709 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.692618    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls podName:d5bcfaad-879c-4173-816a-63ddf0252bec nodeName:}" failed. No retries permitted until 2026-09-06 10:22:23.692602194 +0000 UTC m=+35.471021597 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls") pod "image-registry-6f899d8c59-htkf6" (UID: "d5bcfaad-879c-4173-816a-63ddf0252bec") : secret "image-registry-tls" not found
Sep 06 10:22:22.700771 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.700743    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fcskx"]
Sep 06 10:22:22.703800 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:22:22.703774    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode20c6a2b_e419_4124_884a_b60dac26955d.slice/crio-31cb0cdab07a0b5d6f67938964c70ca0b503c4abf451d4acfc44e1d205899433 WatchSource:0}: Error finding container 31cb0cdab07a0b5d6f67938964c70ca0b503c4abf451d4acfc44e1d205899433: Status 404 returned error can't find the container with id 31cb0cdab07a0b5d6f67938964c70ca0b503c4abf451d4acfc44e1d205899433
Sep 06 10:22:22.725923 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.725897    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-zp6cg"]
Sep 06 10:22:22.728800 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:22:22.728775    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6a44bba_f648_42d6_8865_98df551742f6.slice/crio-63e50aa1adf2013799e748ba61c77c151b818b1a347c42833c4e0de86fb0b74f WatchSource:0}: Error finding container 63e50aa1adf2013799e748ba61c77c151b818b1a347c42833c4e0de86fb0b74f: Status 404 returned error can't find the container with id 63e50aa1adf2013799e748ba61c77c151b818b1a347c42833c4e0de86fb0b74f
Sep 06 10:22:22.735971 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.735869    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h5mgn"]
Sep 06 10:22:22.737024 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.737002    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-fgtkf"]
Sep 06 10:22:22.738852 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:22:22.738828    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfee3641_093e_47c4_bb89_51a039ac335c.slice/crio-8d2d2ae0dad10644fb4882220d74c64860a50566b94d560f1e5bcac737db766b WatchSource:0}: Error finding container 8d2d2ae0dad10644fb4882220d74c64860a50566b94d560f1e5bcac737db766b: Status 404 returned error can't find the container with id 8d2d2ae0dad10644fb4882220d74c64860a50566b94d560f1e5bcac737db766b
Sep 06 10:22:22.740134 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:22:22.740109    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30979a9f_a090_4ced_a423_0f091a73a801.slice/crio-d2c92fffd3d5f5c0eb2dec92a36d57973255af69fef1849e96c8186d0e52efb2 WatchSource:0}: Error finding container d2c92fffd3d5f5c0eb2dec92a36d57973255af69fef1849e96c8186d0e52efb2: Status 404 returned error can't find the container with id d2c92fffd3d5f5c0eb2dec92a36d57973255af69fef1849e96c8186d0e52efb2
Sep 06 10:22:22.793629 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.793605    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:22.793746 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.793645    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:22.793746 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.793679    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-c4fdh\" (UID: \"f8e77ae8-b076-4ca5-9c4a-e433e6fac236\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh"
Sep 06 10:22:22.793746 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:22.793708    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls\") pod \"dns-default-zzn8f\" (UID: \"f9689b0e-8830-4c94-befb-3c64ef549feb\") " pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:22:22.793866 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.793766    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle podName:1056410a-6c66-44ab-b62e-8e2046b73703 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:23.793749357 +0000 UTC m=+35.572168764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle") pod "router-default-66bc586b4-fkkkm" (UID: "1056410a-6c66-44ab-b62e-8e2046b73703") : configmap references non-existent config key: service-ca.crt
Sep 06 10:22:22.793866 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.793770    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 10:22:22.793866 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.793788    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 10:22:22.793866 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.793801    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs podName:1056410a-6c66-44ab-b62e-8e2046b73703 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:23.793794834 +0000 UTC m=+35.572214259 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs") pod "router-default-66bc586b4-fkkkm" (UID: "1056410a-6c66-44ab-b62e-8e2046b73703") : secret "router-metrics-certs-default" not found
Sep 06 10:22:22.793866 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.793812    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 10:22:22.793866 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.793820    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls podName:f9689b0e-8830-4c94-befb-3c64ef549feb nodeName:}" failed. No retries permitted until 2026-09-06 10:22:23.793809589 +0000 UTC m=+35.572229009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls") pod "dns-default-zzn8f" (UID: "f9689b0e-8830-4c94-befb-3c64ef549feb") : secret "dns-default-metrics-tls" not found
Sep 06 10:22:22.794070 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:22.793873    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls podName:f8e77ae8-b076-4ca5-9c4a-e433e6fac236 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:23.793858617 +0000 UTC m=+35.572278022 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-c4fdh" (UID: "f8e77ae8-b076-4ca5-9c4a-e433e6fac236") : secret "samples-operator-tls" not found
Sep 06 10:22:23.056835 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.056797    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-zp6cg" event={"ID":"a6a44bba-f648-42d6-8865-98df551742f6","Type":"ContainerStarted","Data":"63e50aa1adf2013799e748ba61c77c151b818b1a347c42833c4e0de86fb0b74f"}
Sep 06 10:22:23.058141 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.058110    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fcskx" event={"ID":"e20c6a2b-e419-4124-884a-b60dac26955d","Type":"ContainerStarted","Data":"31cb0cdab07a0b5d6f67938964c70ca0b503c4abf451d4acfc44e1d205899433"}
Sep 06 10:22:23.059297 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.059273    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt" event={"ID":"c3c63327-812e-4353-903f-2ad8d3a5b31f","Type":"ContainerStarted","Data":"d49e370818bf031477e4bfe2315c745c899273eec4c87d5f26f53b7b8538c33f"}
Sep 06 10:22:23.060595 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.060572    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p77fj" event={"ID":"8a2b85b1-450b-453c-a0a4-057de1690742","Type":"ContainerStarted","Data":"051d9f7ad56fb90bc98d67c2d9c0971e25ca6cbdad1f2cd491bc2411ddaced9a"}
Sep 06 10:22:23.061784 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.061760    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7px8b" event={"ID":"dbf09546-a6d3-4b10-900a-0940b9c2794e","Type":"ContainerStarted","Data":"fa4ca88a58e9e70fb389f6041dd1ed78be9ee9d1a1b5f55f37defcfde0dd2828"}
Sep 06 10:22:23.062960 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.062933    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h5mgn" event={"ID":"30979a9f-a090-4ced-a423-0f091a73a801","Type":"ContainerStarted","Data":"d2c92fffd3d5f5c0eb2dec92a36d57973255af69fef1849e96c8186d0e52efb2"}
Sep 06 10:22:23.064227 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.064202    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-fgtkf" event={"ID":"dfee3641-093e-47c4-bb89-51a039ac335c","Type":"ContainerStarted","Data":"8d2d2ae0dad10644fb4882220d74c64860a50566b94d560f1e5bcac737db766b"}
Sep 06 10:22:23.701879 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.701848    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jpxdn\" (UID: \"5a7404c4-4386-4f2d-aa64-ea0622b6d073\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn"
Sep 06 10:22:23.702055 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.701923    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:23.702055 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.701985    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-8ljwg\" (UID: \"4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8ljwg"
Sep 06 10:22:23.702055 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:23.702020    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 10:22:23.702219 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:23.702060    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 10:22:23.702219 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:23.702073    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 10:22:23.702219 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:23.702100    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls podName:5a7404c4-4386-4f2d-aa64-ea0622b6d073 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:25.702078892 +0000 UTC m=+37.480498298 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jpxdn" (UID: "5a7404c4-4386-4f2d-aa64-ea0622b6d073") : secret "cluster-monitoring-operator-tls" not found
Sep 06 10:22:23.702219 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:23.702076    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f899d8c59-htkf6: secret "image-registry-tls" not found
Sep 06 10:22:23.702219 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:23.702115    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert podName:4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:25.702108913 +0000 UTC m=+37.480528304 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-8ljwg" (UID: "4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822") : secret "networking-console-plugin-cert" not found
Sep 06 10:22:23.702219 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:23.702133    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls podName:d5bcfaad-879c-4173-816a-63ddf0252bec nodeName:}" failed. No retries permitted until 2026-09-06 10:22:25.702120431 +0000 UTC m=+37.480539825 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls") pod "image-registry-6f899d8c59-htkf6" (UID: "d5bcfaad-879c-4173-816a-63ddf0252bec") : secret "image-registry-tls" not found
Sep 06 10:22:23.747888 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.747862    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:22:23.748042 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.747861    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:22:23.748042 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.747862    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:22:23.750455 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.750432    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 06 10:22:23.750588 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.750438    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 06 10:22:23.751503 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.751478    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xrhk7\""
Sep 06 10:22:23.751605 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.751523    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xmc8p\""
Sep 06 10:22:23.803033 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.803005    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-c4fdh\" (UID: \"f8e77ae8-b076-4ca5-9c4a-e433e6fac236\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh"
Sep 06 10:22:23.803164 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.803063    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls\") pod \"dns-default-zzn8f\" (UID: \"f9689b0e-8830-4c94-befb-3c64ef549feb\") " pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:22:23.803164 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:23.803117    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 10:22:23.803164 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.803133    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:23.803164 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:23.803163    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:23.803359 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:23.803174    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls podName:f8e77ae8-b076-4ca5-9c4a-e433e6fac236 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:25.803160676 +0000 UTC m=+37.581580067 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-c4fdh" (UID: "f8e77ae8-b076-4ca5-9c4a-e433e6fac236") : secret "samples-operator-tls" not found
Sep 06 10:22:23.803359 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:23.803213    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 10:22:23.803359 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:23.803225    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 10:22:23.803359 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:23.803270    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls podName:f9689b0e-8830-4c94-befb-3c64ef549feb nodeName:}" failed. No retries permitted until 2026-09-06 10:22:25.803254143 +0000 UTC m=+37.581673548 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls") pod "dns-default-zzn8f" (UID: "f9689b0e-8830-4c94-befb-3c64ef549feb") : secret "dns-default-metrics-tls" not found
Sep 06 10:22:23.803359 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:23.803289    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle podName:1056410a-6c66-44ab-b62e-8e2046b73703 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:25.803276685 +0000 UTC m=+37.581696094 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle") pod "router-default-66bc586b4-fkkkm" (UID: "1056410a-6c66-44ab-b62e-8e2046b73703") : configmap references non-existent config key: service-ca.crt
Sep 06 10:22:23.803359 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:23.803310    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs podName:1056410a-6c66-44ab-b62e-8e2046b73703 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:25.803300764 +0000 UTC m=+37.581720161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs") pod "router-default-66bc586b4-fkkkm" (UID: "1056410a-6c66-44ab-b62e-8e2046b73703") : secret "router-metrics-certs-default" not found
Sep 06 10:22:25.079586 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:25.078733    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6wfp" event={"ID":"1fec0b65-b25f-4f26-9dd5-facb730de5a8","Type":"ContainerStarted","Data":"883ebe3f8ecf690b5d9e55a1af62f5f2c81d5e13304c50b98c4a66db632479d8"}
Sep 06 10:22:25.721036 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:25.720983    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jpxdn\" (UID: \"5a7404c4-4386-4f2d-aa64-ea0622b6d073\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn"
Sep 06 10:22:25.721212 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:25.721119    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:25.721212 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:25.721140    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 10:22:25.721212 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:25.721207    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-8ljwg\" (UID: \"4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8ljwg"
Sep 06 10:22:25.721390 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:25.721229    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls podName:5a7404c4-4386-4f2d-aa64-ea0622b6d073 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:29.721205344 +0000 UTC m=+41.499624738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jpxdn" (UID: "5a7404c4-4386-4f2d-aa64-ea0622b6d073") : secret "cluster-monitoring-operator-tls" not found
Sep 06 10:22:25.721390 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:25.721281    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 10:22:25.721390 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:25.721302    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f899d8c59-htkf6: secret "image-registry-tls" not found
Sep 06 10:22:25.721390 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:25.721367    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls podName:d5bcfaad-879c-4173-816a-63ddf0252bec nodeName:}" failed. No retries permitted until 2026-09-06 10:22:29.721350571 +0000 UTC m=+41.499769977 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls") pod "image-registry-6f899d8c59-htkf6" (UID: "d5bcfaad-879c-4173-816a-63ddf0252bec") : secret "image-registry-tls" not found
Sep 06 10:22:25.721390 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:25.721283    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 10:22:25.721665 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:25.721413    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert podName:4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:29.721403283 +0000 UTC m=+41.499822697 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-8ljwg" (UID: "4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822") : secret "networking-console-plugin-cert" not found
Sep 06 10:22:25.821894 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:25.821856    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls\") pod \"dns-default-zzn8f\" (UID: \"f9689b0e-8830-4c94-befb-3c64ef549feb\") " pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:22:25.822091 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:25.821972    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:25.822091 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:25.822020    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:25.822091 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:25.822075    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-c4fdh\" (UID: \"f8e77ae8-b076-4ca5-9c4a-e433e6fac236\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh"
Sep 06 10:22:25.822276 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:25.822203    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 10:22:25.822276 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:25.822263    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls podName:f8e77ae8-b076-4ca5-9c4a-e433e6fac236 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:29.822245056 +0000 UTC m=+41.600664462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-c4fdh" (UID: "f8e77ae8-b076-4ca5-9c4a-e433e6fac236") : secret "samples-operator-tls" not found
Sep 06 10:22:25.822979 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:25.822671    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 10:22:25.822979 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:25.822723    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls podName:f9689b0e-8830-4c94-befb-3c64ef549feb nodeName:}" failed. No retries permitted until 2026-09-06 10:22:29.822706939 +0000 UTC m=+41.601126338 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls") pod "dns-default-zzn8f" (UID: "f9689b0e-8830-4c94-befb-3c64ef549feb") : secret "dns-default-metrics-tls" not found
Sep 06 10:22:25.822979 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:25.822789    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle podName:1056410a-6c66-44ab-b62e-8e2046b73703 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:29.822778883 +0000 UTC m=+41.601198279 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle") pod "router-default-66bc586b4-fkkkm" (UID: "1056410a-6c66-44ab-b62e-8e2046b73703") : configmap references non-existent config key: service-ca.crt
Sep 06 10:22:25.822979 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:25.822842    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 10:22:25.822979 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:25.822870    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs podName:1056410a-6c66-44ab-b62e-8e2046b73703 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:29.822861001 +0000 UTC m=+41.601280398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs") pod "router-default-66bc586b4-fkkkm" (UID: "1056410a-6c66-44ab-b62e-8e2046b73703") : secret "router-metrics-certs-default" not found
Sep 06 10:22:26.096639 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:26.096564    2561 generic.go:356] "Generic (PLEG): container finished" podID="1fec0b65-b25f-4f26-9dd5-facb730de5a8" containerID="883ebe3f8ecf690b5d9e55a1af62f5f2c81d5e13304c50b98c4a66db632479d8" exitCode=0
Sep 06 10:22:26.096639 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:26.096632    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6wfp" event={"ID":"1fec0b65-b25f-4f26-9dd5-facb730de5a8","Type":"ContainerDied","Data":"883ebe3f8ecf690b5d9e55a1af62f5f2c81d5e13304c50b98c4a66db632479d8"}
Sep 06 10:22:27.103598 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:27.103530    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6wfp" event={"ID":"1fec0b65-b25f-4f26-9dd5-facb730de5a8","Type":"ContainerStarted","Data":"5c14275f5dd252171623cec703c4962ba84ec8d73b749ca7b391466b46e490eb"}
Sep 06 10:22:27.376414 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:27.376340    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:27.464068 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:27.464033    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:27.713446 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:27.713406    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:27.789900 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:27.789862    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:28.109700 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:28.109619    2561 generic.go:356] "Generic (PLEG): container finished" podID="1fec0b65-b25f-4f26-9dd5-facb730de5a8" containerID="5c14275f5dd252171623cec703c4962ba84ec8d73b749ca7b391466b46e490eb" exitCode=0
Sep 06 10:22:28.109700 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:28.109667    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6wfp" event={"ID":"1fec0b65-b25f-4f26-9dd5-facb730de5a8","Type":"ContainerDied","Data":"5c14275f5dd252171623cec703c4962ba84ec8d73b749ca7b391466b46e490eb"}
Sep 06 10:22:28.489360 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:28.489311    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:28.545439 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:28.545405    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:28.960742 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:28.960707    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:29.015129 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:29.015099    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:29.757659 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:29.757623    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jpxdn\" (UID: \"5a7404c4-4386-4f2d-aa64-ea0622b6d073\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn"
Sep 06 10:22:29.758101 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:29.757715    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:29.758101 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:29.757791    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-8ljwg\" (UID: \"4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8ljwg"
Sep 06 10:22:29.758101 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:29.757805    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 10:22:29.758101 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:29.757891    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls podName:5a7404c4-4386-4f2d-aa64-ea0622b6d073 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:37.757870591 +0000 UTC m=+49.536289998 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jpxdn" (UID: "5a7404c4-4386-4f2d-aa64-ea0622b6d073") : secret "cluster-monitoring-operator-tls" not found
Sep 06 10:22:29.758101 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:29.757890    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 10:22:29.758101 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:29.757915    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f899d8c59-htkf6: secret "image-registry-tls" not found
Sep 06 10:22:29.758101 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:29.757924    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 10:22:29.758101 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:29.757990    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls podName:d5bcfaad-879c-4173-816a-63ddf0252bec nodeName:}" failed. No retries permitted until 2026-09-06 10:22:37.757970576 +0000 UTC m=+49.536389971 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls") pod "image-registry-6f899d8c59-htkf6" (UID: "d5bcfaad-879c-4173-816a-63ddf0252bec") : secret "image-registry-tls" not found
Sep 06 10:22:29.758101 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:29.758009    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert podName:4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:37.757998835 +0000 UTC m=+49.536418232 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-8ljwg" (UID: "4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822") : secret "networking-console-plugin-cert" not found
Sep 06 10:22:29.858915 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:29.858873    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:29.859076 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:29.858956    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-c4fdh\" (UID: \"f8e77ae8-b076-4ca5-9c4a-e433e6fac236\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh"
Sep 06 10:22:29.859076 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:29.859008    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls\") pod \"dns-default-zzn8f\" (UID: \"f9689b0e-8830-4c94-befb-3c64ef549feb\") " pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:22:29.859076 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:29.859025    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 10:22:29.859227 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:29.859087    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs podName:1056410a-6c66-44ab-b62e-8e2046b73703 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:37.859069736 +0000 UTC m=+49.637489140 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs") pod "router-default-66bc586b4-fkkkm" (UID: "1056410a-6c66-44ab-b62e-8e2046b73703") : secret "router-metrics-certs-default" not found
Sep 06 10:22:29.859227 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:29.859133    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 10:22:29.859227 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:29.859152    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 10:22:29.859227 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:29.859180    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls podName:f9689b0e-8830-4c94-befb-3c64ef549feb nodeName:}" failed. No retries permitted until 2026-09-06 10:22:37.859168413 +0000 UTC m=+49.637587818 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls") pod "dns-default-zzn8f" (UID: "f9689b0e-8830-4c94-befb-3c64ef549feb") : secret "dns-default-metrics-tls" not found
Sep 06 10:22:29.859227 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:29.859132    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:29.859227 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:29.859195    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle podName:1056410a-6c66-44ab-b62e-8e2046b73703 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:37.859185598 +0000 UTC m=+49.637604995 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle") pod "router-default-66bc586b4-fkkkm" (UID: "1056410a-6c66-44ab-b62e-8e2046b73703") : configmap references non-existent config key: service-ca.crt
Sep 06 10:22:29.859227 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:29.859214    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls podName:f8e77ae8-b076-4ca5-9c4a-e433e6fac236 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:37.85920641 +0000 UTC m=+49.637625807 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-c4fdh" (UID: "f8e77ae8-b076-4ca5-9c4a-e433e6fac236") : secret "samples-operator-tls" not found
Sep 06 10:22:31.047777 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:31.047738    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:31.109381 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:31.109351    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:31.299275 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:31.299183    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:31.352823 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:31.352781    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:33.126745 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.126711    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/0.log"
Sep 06 10:22:33.127291 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.126761    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfee3641-093e-47c4-bb89-51a039ac335c" containerID="ab752ffa60b747a1fc7128910cbde9f7bcb12ead657c7aafc63d8ee9a0feb333" exitCode=255
Sep 06 10:22:33.127291 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.126841    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-fgtkf" event={"ID":"dfee3641-093e-47c4-bb89-51a039ac335c","Type":"ContainerDied","Data":"ab752ffa60b747a1fc7128910cbde9f7bcb12ead657c7aafc63d8ee9a0feb333"}
Sep 06 10:22:33.127291 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.127115    2561 scope.go:117] "RemoveContainer" containerID="ab752ffa60b747a1fc7128910cbde9f7bcb12ead657c7aafc63d8ee9a0feb333"
Sep 06 10:22:33.134616 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.134556    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-zp6cg" event={"ID":"a6a44bba-f648-42d6-8865-98df551742f6","Type":"ContainerStarted","Data":"ed06ac4c4192b95a259e808cbeeaa2b25fe1132664b0c6e0a57dad1d0fd15b22"}
Sep 06 10:22:33.136805 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.136784    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fcskx" event={"ID":"e20c6a2b-e419-4124-884a-b60dac26955d","Type":"ContainerStarted","Data":"6db20a779d24b17bbd283ddbd142d44149ce5ccb5dc75e6d8fb326a9e706de5c"}
Sep 06 10:22:33.138476 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.138452    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt" event={"ID":"c3c63327-812e-4353-903f-2ad8d3a5b31f","Type":"ContainerStarted","Data":"e218b8204823358765b1f546d6d874e7963fb0b3fe6a8ec3533a9d6ec8e07d7f"}
Sep 06 10:22:33.140606 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.140585    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p77fj" event={"ID":"8a2b85b1-450b-453c-a0a4-057de1690742","Type":"ContainerStarted","Data":"799707b0cee1520ba8e919ccb6eeea623b6a555bd3e5fd4c72d06fd29aca56af"}
Sep 06 10:22:33.144123 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.144101    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h6wfp" event={"ID":"1fec0b65-b25f-4f26-9dd5-facb730de5a8","Type":"ContainerStarted","Data":"03354589fe96e6173f7557fea37a7295a5e769c7ec20373fea29172634fd8517"}
Sep 06 10:22:33.147183 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.147156    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7px8b" event={"ID":"dbf09546-a6d3-4b10-900a-0940b9c2794e","Type":"ContainerStarted","Data":"6c4d3cbe16c9ef6323d848cb0b5986e82e201d4d78e3face82cd191d4df51540"}
Sep 06 10:22:33.149231 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.149205    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h5mgn" event={"ID":"30979a9f-a090-4ced-a423-0f091a73a801","Type":"ContainerStarted","Data":"1edff6faf6751949f8906dc81735a3d09aafd109ced8f4d79e0572fc6dca7926"}
Sep 06 10:22:33.165816 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.165767    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p77fj" podStartSLOduration=16.643924846 podStartE2EDuration="26.165747944s" totalImagesPullingTime="9.521823098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:33.164683384 +0000 UTC m=+44.943102799" watchObservedRunningTime="2026-09-06 10:22:33.165747944 +0000 UTC m=+44.944167366"
Sep 06 10:22:33.180871 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.180684    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-zp6cg" podStartSLOduration=16.756035497 podStartE2EDuration="26.180664547s" totalImagesPullingTime="9.42462905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:33.180419162 +0000 UTC m=+44.958838568" watchObservedRunningTime="2026-09-06 10:22:33.180664547 +0000 UTC m=+44.959083963"
Sep 06 10:22:33.204699 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.204595    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h6wfp" podStartSLOduration=13.04380349 podStartE2EDuration="44.204578166s" totalImagesPullingTime="31.160774676s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 10:21:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:33.203061097 +0000 UTC m=+44.981480512" watchObservedRunningTime="2026-09-06 10:22:33.204578166 +0000 UTC m=+44.982997582"
Sep 06 10:22:33.220408 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.220359    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7px8b" podStartSLOduration=17.301170936 podStartE2EDuration="26.220313567s" totalImagesPullingTime="8.919142631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:33.219721362 +0000 UTC m=+44.998140776" watchObservedRunningTime="2026-09-06 10:22:33.220313567 +0000 UTC m=+44.998732980"
Sep 06 10:22:33.260436 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.260386    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fcskx" podStartSLOduration=16.820270009 podStartE2EDuration="26.260365514s" totalImagesPullingTime="9.440095505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:33.259635601 +0000 UTC m=+45.038055015" watchObservedRunningTime="2026-09-06 10:22:33.260365514 +0000 UTC m=+45.038784928"
Sep 06 10:22:33.261429 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.261390    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt" podStartSLOduration=16.756185895 podStartE2EDuration="26.261372792s" totalImagesPullingTime="9.505186897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:33.239891987 +0000 UTC m=+45.018311401" watchObservedRunningTime="2026-09-06 10:22:33.261372792 +0000 UTC m=+45.039792197"
Sep 06 10:22:33.279354 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.279140    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h5mgn" podStartSLOduration=1.875519844 podStartE2EDuration="11.279120178s" totalImagesPullingTime="9.403600334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:22:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:33.277505281 +0000 UTC m=+45.055924695" watchObservedRunningTime="2026-09-06 10:22:33.279120178 +0000 UTC m=+45.057539593"
Sep 06 10:22:33.325378 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.325350    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:33.377508 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.377447    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:33.611242 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.611202    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:33.653469 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.653390    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nt7q7"]
Sep 06 10:22:33.673701 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.673672    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nt7q7"]
Sep 06 10:22:33.673848 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.673795    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:33.676458 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.676418    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 06 10:22:33.676913 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.676887    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 06 10:22:33.677027 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.676945    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p462p\""
Sep 06 10:22:33.684223 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.684197    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:33.798596 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.798564    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24cng\" (UniqueName: \"kubernetes.io/projected/db9a6bc0-79fe-4914-bee3-adc09cdcd439-kube-api-access-24cng\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:33.798755 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.798632    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/db9a6bc0-79fe-4914-bee3-adc09cdcd439-crio-socket\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:33.798755 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.798678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/db9a6bc0-79fe-4914-bee3-adc09cdcd439-data-volume\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:33.798755 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.798739    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db9a6bc0-79fe-4914-bee3-adc09cdcd439-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:33.798859 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.798763    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db9a6bc0-79fe-4914-bee3-adc09cdcd439-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:33.899132 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.899097    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db9a6bc0-79fe-4914-bee3-adc09cdcd439-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:33.899283 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.899139    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db9a6bc0-79fe-4914-bee3-adc09cdcd439-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:33.899283 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.899163    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24cng\" (UniqueName: \"kubernetes.io/projected/db9a6bc0-79fe-4914-bee3-adc09cdcd439-kube-api-access-24cng\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:33.899283 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:33.899233    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 10:22:33.899283 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:33.899263    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 10:22:33.899543 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:33.899304    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db9a6bc0-79fe-4914-bee3-adc09cdcd439-kube-rbac-proxy-cm podName:db9a6bc0-79fe-4914-bee3-adc09cdcd439 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:34.399287107 +0000 UTC m=+46.177706511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/db9a6bc0-79fe-4914-bee3-adc09cdcd439-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nt7q7" (UID: "db9a6bc0-79fe-4914-bee3-adc09cdcd439") : configmap "kube-rbac-proxy" not found
Sep 06 10:22:33.899543 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:33.899351    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db9a6bc0-79fe-4914-bee3-adc09cdcd439-insights-runtime-extractor-tls podName:db9a6bc0-79fe-4914-bee3-adc09cdcd439 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:34.399318219 +0000 UTC m=+46.177737630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/db9a6bc0-79fe-4914-bee3-adc09cdcd439-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nt7q7" (UID: "db9a6bc0-79fe-4914-bee3-adc09cdcd439") : secret "insights-runtime-extractor-tls" not found
Sep 06 10:22:33.899543 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.899409    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/db9a6bc0-79fe-4914-bee3-adc09cdcd439-crio-socket\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:33.899543 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.899489    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/db9a6bc0-79fe-4914-bee3-adc09cdcd439-data-volume\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:33.899760 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.899615    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/db9a6bc0-79fe-4914-bee3-adc09cdcd439-crio-socket\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:33.899870 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.899851    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/db9a6bc0-79fe-4914-bee3-adc09cdcd439-data-volume\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:33.911022 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:33.910998    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24cng\" (UniqueName: \"kubernetes.io/projected/db9a6bc0-79fe-4914-bee3-adc09cdcd439-kube-api-access-24cng\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:34.028739 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:34.028707    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:34.129895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:34.129861    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:34.154792 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:34.154763    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/1.log"
Sep 06 10:22:34.155199 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:34.155186    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/0.log"
Sep 06 10:22:34.155262 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:34.155216    2561 generic.go:356] "Generic (PLEG): container finished" podID="dfee3641-093e-47c4-bb89-51a039ac335c" containerID="cfbc8006ebc80fefe1ceade9d272439e5823a1509591ccf66065ca62c349d8e0" exitCode=255
Sep 06 10:22:34.155349 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:34.155315    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-fgtkf" event={"ID":"dfee3641-093e-47c4-bb89-51a039ac335c","Type":"ContainerDied","Data":"cfbc8006ebc80fefe1ceade9d272439e5823a1509591ccf66065ca62c349d8e0"}
Sep 06 10:22:34.155410 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:34.155400    2561 scope.go:117] "RemoveContainer" containerID="ab752ffa60b747a1fc7128910cbde9f7bcb12ead657c7aafc63d8ee9a0feb333"
Sep 06 10:22:34.155668 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:34.155628    2561 scope.go:117] "RemoveContainer" containerID="cfbc8006ebc80fefe1ceade9d272439e5823a1509591ccf66065ca62c349d8e0"
Sep 06 10:22:34.155859 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:34.155836    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-fgtkf_openshift-console-operator(dfee3641-093e-47c4-bb89-51a039ac335c)\"" pod="openshift-console-operator/console-operator-85b454874b-fgtkf" podUID="dfee3641-093e-47c4-bb89-51a039ac335c"
Sep 06 10:22:34.325950 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:34.325918    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:34.405905 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:34.405872    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db9a6bc0-79fe-4914-bee3-adc09cdcd439-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:34.406063 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:34.405917    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db9a6bc0-79fe-4914-bee3-adc09cdcd439-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:34.406063 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:34.405992    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 10:22:34.406063 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:34.406059    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db9a6bc0-79fe-4914-bee3-adc09cdcd439-kube-rbac-proxy-cm podName:db9a6bc0-79fe-4914-bee3-adc09cdcd439 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:35.406044751 +0000 UTC m=+47.184464155 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/db9a6bc0-79fe-4914-bee3-adc09cdcd439-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nt7q7" (UID: "db9a6bc0-79fe-4914-bee3-adc09cdcd439") : configmap "kube-rbac-proxy" not found
Sep 06 10:22:34.406188 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:34.406086    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 10:22:34.406188 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:34.406150    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db9a6bc0-79fe-4914-bee3-adc09cdcd439-insights-runtime-extractor-tls podName:db9a6bc0-79fe-4914-bee3-adc09cdcd439 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:35.406134939 +0000 UTC m=+47.184554331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/db9a6bc0-79fe-4914-bee3-adc09cdcd439-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nt7q7" (UID: "db9a6bc0-79fe-4914-bee3-adc09cdcd439") : secret "insights-runtime-extractor-tls" not found
Sep 06 10:22:34.421288 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:34.421264    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:35.160537 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:35.160507    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/1.log"
Sep 06 10:22:35.160895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:35.160816    2561 scope.go:117] "RemoveContainer" containerID="cfbc8006ebc80fefe1ceade9d272439e5823a1509591ccf66065ca62c349d8e0"
Sep 06 10:22:35.160975 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:35.160957    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-fgtkf_openshift-console-operator(dfee3641-093e-47c4-bb89-51a039ac335c)\"" pod="openshift-console-operator/console-operator-85b454874b-fgtkf" podUID="dfee3641-093e-47c4-bb89-51a039ac335c"
Sep 06 10:22:35.355969 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:35.355939    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:35.416224 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:35.416151    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db9a6bc0-79fe-4914-bee3-adc09cdcd439-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:35.416224 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:35.416195    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db9a6bc0-79fe-4914-bee3-adc09cdcd439-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:35.416444 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:35.416285    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 10:22:35.416444 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:35.416298    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 10:22:35.416444 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:35.416363    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db9a6bc0-79fe-4914-bee3-adc09cdcd439-insights-runtime-extractor-tls podName:db9a6bc0-79fe-4914-bee3-adc09cdcd439 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:37.416349907 +0000 UTC m=+49.194769298 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/db9a6bc0-79fe-4914-bee3-adc09cdcd439-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nt7q7" (UID: "db9a6bc0-79fe-4914-bee3-adc09cdcd439") : secret "insights-runtime-extractor-tls" not found
Sep 06 10:22:35.416444 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:35.416378    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db9a6bc0-79fe-4914-bee3-adc09cdcd439-kube-rbac-proxy-cm podName:db9a6bc0-79fe-4914-bee3-adc09cdcd439 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:37.416369721 +0000 UTC m=+49.194789112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/db9a6bc0-79fe-4914-bee3-adc09cdcd439-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nt7q7" (UID: "db9a6bc0-79fe-4914-bee3-adc09cdcd439") : configmap "kube-rbac-proxy" not found
Sep 06 10:22:35.457157 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:35.457128    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:35.817185 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:35.817111    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mtfnz_3e728c52-da89-4425-b478-c21e3eea361a/dns-node-resolver/0.log"
Sep 06 10:22:35.943748 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:35.943714    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:36.045864 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:36.045825    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:36.809770 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:36.809737    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:36.818303 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:36.818283    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zr4w8_4e601580-f2cf-423c-bf46-337104486a51/node-ca/0.log"
Sep 06 10:22:37.418266 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:37.418233    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h5mgn_30979a9f-a090-4ced-a423-0f091a73a801/serve-healthcheck-canary/0.log"
Sep 06 10:22:37.433563 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:37.433533    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db9a6bc0-79fe-4914-bee3-adc09cdcd439-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:37.433673 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:37.433573    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db9a6bc0-79fe-4914-bee3-adc09cdcd439-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:37.433712 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:37.433667    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 10:22:37.433750 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:37.433734    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db9a6bc0-79fe-4914-bee3-adc09cdcd439-kube-rbac-proxy-cm podName:db9a6bc0-79fe-4914-bee3-adc09cdcd439 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:41.433718283 +0000 UTC m=+53.212137688 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/db9a6bc0-79fe-4914-bee3-adc09cdcd439-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nt7q7" (UID: "db9a6bc0-79fe-4914-bee3-adc09cdcd439") : configmap "kube-rbac-proxy" not found
Sep 06 10:22:37.433790 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:37.433754    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 10:22:37.433822 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:37.433803    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db9a6bc0-79fe-4914-bee3-adc09cdcd439-insights-runtime-extractor-tls podName:db9a6bc0-79fe-4914-bee3-adc09cdcd439 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:41.433790666 +0000 UTC m=+53.212210073 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/db9a6bc0-79fe-4914-bee3-adc09cdcd439-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nt7q7" (UID: "db9a6bc0-79fe-4914-bee3-adc09cdcd439") : secret "insights-runtime-extractor-tls" not found
Sep 06 10:22:37.837272 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:37.837191    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-8ljwg\" (UID: \"4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8ljwg"
Sep 06 10:22:37.837272 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:37.837256    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jpxdn\" (UID: \"5a7404c4-4386-4f2d-aa64-ea0622b6d073\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn"
Sep 06 10:22:37.837704 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:37.837361    2561 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 10:22:37.837704 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:37.837378    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 10:22:37.837704 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:37.837422    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert podName:4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:53.837407241 +0000 UTC m=+65.615826650 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-8ljwg" (UID: "4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822") : secret "networking-console-plugin-cert" not found
Sep 06 10:22:37.837704 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:37.837466    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:37.837704 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:37.837499    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls podName:5a7404c4-4386-4f2d-aa64-ea0622b6d073 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:53.837481004 +0000 UTC m=+65.615900403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-jpxdn" (UID: "5a7404c4-4386-4f2d-aa64-ea0622b6d073") : secret "cluster-monitoring-operator-tls" not found
Sep 06 10:22:37.837704 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:37.837517    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 10:22:37.837704 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:37.837525    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6f899d8c59-htkf6: secret "image-registry-tls" not found
Sep 06 10:22:37.837704 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:37.837553    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls podName:d5bcfaad-879c-4173-816a-63ddf0252bec nodeName:}" failed. No retries permitted until 2026-09-06 10:22:53.837545296 +0000 UTC m=+65.615964687 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls") pod "image-registry-6f899d8c59-htkf6" (UID: "d5bcfaad-879c-4173-816a-63ddf0252bec") : secret "image-registry-tls" not found
Sep 06 10:22:37.937967 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:37.937932    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-c4fdh\" (UID: \"f8e77ae8-b076-4ca5-9c4a-e433e6fac236\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh"
Sep 06 10:22:37.938130 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:37.937978    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls\") pod \"dns-default-zzn8f\" (UID: \"f9689b0e-8830-4c94-befb-3c64ef549feb\") " pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:22:37.938130 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:37.938056    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:37.938130 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:37.938070    2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 10:22:37.938130 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:37.938106    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:37.938130 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:37.938127    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls podName:f8e77ae8-b076-4ca5-9c4a-e433e6fac236 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:53.938113482 +0000 UTC m=+65.716532873 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-c4fdh" (UID: "f8e77ae8-b076-4ca5-9c4a-e433e6fac236") : secret "samples-operator-tls" not found
Sep 06 10:22:37.938421 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:37.938143    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 10:22:37.938421 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:37.938163    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 10:22:37.938421 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:37.938197    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls podName:f9689b0e-8830-4c94-befb-3c64ef549feb nodeName:}" failed. No retries permitted until 2026-09-06 10:22:53.938181809 +0000 UTC m=+65.716601219 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls") pod "dns-default-zzn8f" (UID: "f9689b0e-8830-4c94-befb-3c64ef549feb") : secret "dns-default-metrics-tls" not found
Sep 06 10:22:37.938421 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:37.938213    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs podName:1056410a-6c66-44ab-b62e-8e2046b73703 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:53.93820561 +0000 UTC m=+65.716625003 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs") pod "router-default-66bc586b4-fkkkm" (UID: "1056410a-6c66-44ab-b62e-8e2046b73703") : secret "router-metrics-certs-default" not found
Sep 06 10:22:37.938421 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:37.938222    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle podName:1056410a-6c66-44ab-b62e-8e2046b73703 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:53.938217406 +0000 UTC m=+65.716636797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle") pod "router-default-66bc586b4-fkkkm" (UID: "1056410a-6c66-44ab-b62e-8e2046b73703") : configmap references non-existent config key: service-ca.crt
Sep 06 10:22:38.643402 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:38.643370    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:40.096081 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:40.096041    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:40.196917 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:40.196883    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:40.298584 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:40.298549    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:40.398051 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:40.397961    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:41.187582 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:41.187545    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:41.470542 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:41.470438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db9a6bc0-79fe-4914-bee3-adc09cdcd439-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:41.470542 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:41.470500    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db9a6bc0-79fe-4914-bee3-adc09cdcd439-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:41.470736 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:41.470594    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 10:22:41.470736 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:41.470660    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db9a6bc0-79fe-4914-bee3-adc09cdcd439-insights-runtime-extractor-tls podName:db9a6bc0-79fe-4914-bee3-adc09cdcd439 nodeName:}" failed. No retries permitted until 2026-09-06 10:22:49.470646696 +0000 UTC m=+61.249066099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/db9a6bc0-79fe-4914-bee3-adc09cdcd439-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nt7q7" (UID: "db9a6bc0-79fe-4914-bee3-adc09cdcd439") : secret "insights-runtime-extractor-tls" not found
Sep 06 10:22:41.470955 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:41.470935    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db9a6bc0-79fe-4914-bee3-adc09cdcd439-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:41.587503 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:41.587468    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:41.988170 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:41.988129    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:42.384664 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:42.384580    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:42.429779 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:42.429739    2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-fgtkf"
Sep 06 10:22:42.429940 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:42.429800    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-fgtkf"
Sep 06 10:22:42.430152 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:42.430140    2561 scope.go:117] "RemoveContainer" containerID="cfbc8006ebc80fefe1ceade9d272439e5823a1509591ccf66065ca62c349d8e0"
Sep 06 10:22:42.430317 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:22:42.430300    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-fgtkf_openshift-console-operator(dfee3641-093e-47c4-bb89-51a039ac335c)\"" pod="openshift-console-operator/console-operator-85b454874b-fgtkf" podUID="dfee3641-093e-47c4-bb89-51a039ac335c"
Sep 06 10:22:42.593518 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:42.593482    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:43.180198 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:43.180166    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:43.585421 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:43.585337    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:43.780211 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:43.780179    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:43.902913 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:43.902812    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:44.003567 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:44.003533    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:44.387449 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:44.387417    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:44.587201 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:44.587161    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:44.639397 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:44.639332    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:45.194003 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:45.193972    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:45.583681 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:45.583599    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:45.685504 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:45.685471    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:45.786143 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:45.786107    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:45.979781 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:45.979747    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:46.186779 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:46.186750    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:46.290001 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:46.289905    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:46.390550 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:46.390515    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:46.450650 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:46.450620    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:46.795600 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:46.795569    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:47.187650 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:47.187623    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:47.592336 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:47.592245    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:47.787488 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:47.787455    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:48.187220 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:48.187176    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:48.588791 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:48.588703    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:48.785492 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:48.785463    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:49.198930 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:49.198891    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:49.536973 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:49.536881    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db9a6bc0-79fe-4914-bee3-adc09cdcd439-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:49.539122 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:49.539104    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db9a6bc0-79fe-4914-bee3-adc09cdcd439-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nt7q7\" (UID: \"db9a6bc0-79fe-4914-bee3-adc09cdcd439\") " pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:49.587973 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:49.587944    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p462p\""
Sep 06 10:22:49.590104 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:49.590078    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:49.596930 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:49.596913    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nt7q7"
Sep 06 10:22:49.783377 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:49.783309    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:49.875782 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:49.875710    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nt7q7"]
Sep 06 10:22:49.878817 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:22:49.878790    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb9a6bc0_79fe_4914_bee3_adc09cdcd439.slice/crio-87e83422336366c8856fc27ee6f9de0323c7db81785a1eec12cc5d03e7d5fcd6 WatchSource:0}: Error finding container 87e83422336366c8856fc27ee6f9de0323c7db81785a1eec12cc5d03e7d5fcd6: Status 404 returned error can't find the container with id 87e83422336366c8856fc27ee6f9de0323c7db81785a1eec12cc5d03e7d5fcd6
Sep 06 10:22:50.185451 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:50.185412    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:50.208879 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:50.208848    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nt7q7" event={"ID":"db9a6bc0-79fe-4914-bee3-adc09cdcd439","Type":"ContainerStarted","Data":"e82d9933a3ca9d31dd385e20ab1cf4c1b5f4550e8e6655ad4740af92315ff265"}
Sep 06 10:22:50.209198 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:50.208901    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nt7q7" event={"ID":"db9a6bc0-79fe-4914-bee3-adc09cdcd439","Type":"ContainerStarted","Data":"87e83422336366c8856fc27ee6f9de0323c7db81785a1eec12cc5d03e7d5fcd6"}
Sep 06 10:22:50.584426 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:50.584399    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:50.789418 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:50.789306    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:51.215469 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:51.215427    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nt7q7" event={"ID":"db9a6bc0-79fe-4914-bee3-adc09cdcd439","Type":"ContainerStarted","Data":"a8d3c22a5f59697b425c759e1c8f0c83108f337bf0e4a00e81dbfefb78fd59b9"}
Sep 06 10:22:52.220653 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:52.220618    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nt7q7" event={"ID":"db9a6bc0-79fe-4914-bee3-adc09cdcd439","Type":"ContainerStarted","Data":"688efd10c0399b5b43b8fde525a12c9cc577cfd47364e9c595fb93643fb55947"}
Sep 06 10:22:52.237650 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:52.237609    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nt7q7" podStartSLOduration=17.208036664 podStartE2EDuration="19.237595033s" totalImagesPullingTime="2.029558369s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 10:22:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:52.236481851 +0000 UTC m=+64.014901275" watchObservedRunningTime="2026-09-06 10:22:52.237595033 +0000 UTC m=+64.016014446"
Sep 06 10:22:53.572212 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.572173    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret\") pod \"global-pull-secret-syncer-nkc66\" (UID: \"4ff152b4-4c19-4c64-af60-41eeb9cbb81e\") " pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:22:53.572658 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.572273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs\") pod \"network-metrics-daemon-6prgq\" (UID: \"705da257-7931-44ef-89b4-070ba34f4cb0\") " pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:22:53.574840 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.574819    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 06 10:22:53.574931 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.574882    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 06 10:22:53.585075 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.585054    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4ff152b4-4c19-4c64-af60-41eeb9cbb81e-original-pull-secret\") pod \"global-pull-secret-syncer-nkc66\" (UID: \"4ff152b4-4c19-4c64-af60-41eeb9cbb81e\") " pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:22:53.585075 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.585067    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/705da257-7931-44ef-89b4-070ba34f4cb0-metrics-certs\") pod \"network-metrics-daemon-6prgq\" (UID: \"705da257-7931-44ef-89b4-070ba34f4cb0\") " pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:22:53.673256 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.673221    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqpmj\" (UniqueName: \"kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj\") pod \"network-check-target-gdhpd\" (UID: \"77c1dc1a-0efd-4422-842c-c630206d37a0\") " pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:22:53.675617 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.675590    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqpmj\" (UniqueName: \"kubernetes.io/projected/77c1dc1a-0efd-4422-842c-c630206d37a0-kube-api-access-hqpmj\") pod \"network-check-target-gdhpd\" (UID: \"77c1dc1a-0efd-4422-842c-c630206d37a0\") " pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:22:53.761448 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.761419    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xrhk7\""
Sep 06 10:22:53.768564 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.768546    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xmc8p\""
Sep 06 10:22:53.769608 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.769595    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:22:53.771124 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.771106    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkc66"
Sep 06 10:22:53.776294 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.776281    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6prgq"
Sep 06 10:22:53.875033 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.874996    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jpxdn\" (UID: \"5a7404c4-4386-4f2d-aa64-ea0622b6d073\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn"
Sep 06 10:22:53.875265 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.875244    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:53.875375 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.875353    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-8ljwg\" (UID: \"4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8ljwg"
Sep 06 10:22:53.878845 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.878671    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a7404c4-4386-4f2d-aa64-ea0622b6d073-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-jpxdn\" (UID: \"5a7404c4-4386-4f2d-aa64-ea0622b6d073\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn"
Sep 06 10:22:53.878845 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.878730    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-8ljwg\" (UID: \"4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822\") " pod="openshift-network-console/networking-console-plugin-79977f9844-8ljwg"
Sep 06 10:22:53.879857 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.879796    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls\") pod \"image-registry-6f899d8c59-htkf6\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") " pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:53.977000 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.976972    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:53.977111 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.977012    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:53.977150 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.977130    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-c4fdh\" (UID: \"f8e77ae8-b076-4ca5-9c4a-e433e6fac236\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh"
Sep 06 10:22:53.977190 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.977172    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls\") pod \"dns-default-zzn8f\" (UID: \"f9689b0e-8830-4c94-befb-3c64ef549feb\") " pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:22:53.977655 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.977627    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1056410a-6c66-44ab-b62e-8e2046b73703-service-ca-bundle\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:53.979165 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.979146    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9689b0e-8830-4c94-befb-3c64ef549feb-metrics-tls\") pod \"dns-default-zzn8f\" (UID: \"f9689b0e-8830-4c94-befb-3c64ef549feb\") " pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:22:53.979241 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.979190    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1056410a-6c66-44ab-b62e-8e2046b73703-metrics-certs\") pod \"router-default-66bc586b4-fkkkm\" (UID: \"1056410a-6c66-44ab-b62e-8e2046b73703\") " pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:53.979285 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:53.979246    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f8e77ae8-b076-4ca5-9c4a-e433e6fac236-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-c4fdh\" (UID: \"f8e77ae8-b076-4ca5-9c4a-e433e6fac236\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh"
Sep 06 10:22:54.065703 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.065676    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gdhpd"]
Sep 06 10:22:54.068220 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:22:54.068201    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c1dc1a_0efd_4422_842c_c630206d37a0.slice/crio-20bb296a1c404835e7991f9bb7890599e88378730f157e1e2564bdd629b36888 WatchSource:0}: Error finding container 20bb296a1c404835e7991f9bb7890599e88378730f157e1e2564bdd629b36888: Status 404 returned error can't find the container with id 20bb296a1c404835e7991f9bb7890599e88378730f157e1e2564bdd629b36888
Sep 06 10:22:54.095227 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.095175    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nkc66"]
Sep 06 10:22:54.097669 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:22:54.097646    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff152b4_4c19_4c64_af60_41eeb9cbb81e.slice/crio-0fd7629bfc9a90ce52994a0997d282f8d6ba22be606d5325d83eab4e6d4d1611 WatchSource:0}: Error finding container 0fd7629bfc9a90ce52994a0997d282f8d6ba22be606d5325d83eab4e6d4d1611: Status 404 returned error can't find the container with id 0fd7629bfc9a90ce52994a0997d282f8d6ba22be606d5325d83eab4e6d4d1611
Sep 06 10:22:54.120941 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.120885    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6prgq"]
Sep 06 10:22:54.123059 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:22:54.123036    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod705da257_7931_44ef_89b4_070ba34f4cb0.slice/crio-e9bf68c568a3ae03ea7500e996fa7e24e1bd6090f922899bf2b4a39626799728 WatchSource:0}: Error finding container e9bf68c568a3ae03ea7500e996fa7e24e1bd6090f922899bf2b4a39626799728: Status 404 returned error can't find the container with id e9bf68c568a3ae03ea7500e996fa7e24e1bd6090f922899bf2b4a39626799728
Sep 06 10:22:54.135651 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.135631    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4td26\""
Sep 06 10:22:54.144633 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.144615    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:54.170103 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.170083    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-scjzs\""
Sep 06 10:22:54.178163 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.178139    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-8ljwg"
Sep 06 10:22:54.180123 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.180106    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-slwq8\""
Sep 06 10:22:54.189157 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.189139    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn"
Sep 06 10:22:54.194168 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.194151    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bd2dz\""
Sep 06 10:22:54.202869 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.202848    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh"
Sep 06 10:22:54.203018 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.203001    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-k75fj\""
Sep 06 10:22:54.211574 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.211486    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:54.226065 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.226028    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mhwb9\""
Sep 06 10:22:54.228894 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.228865    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nkc66" event={"ID":"4ff152b4-4c19-4c64-af60-41eeb9cbb81e","Type":"ContainerStarted","Data":"0fd7629bfc9a90ce52994a0997d282f8d6ba22be606d5325d83eab4e6d4d1611"}
Sep 06 10:22:54.231212 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.230887    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gdhpd" event={"ID":"77c1dc1a-0efd-4422-842c-c630206d37a0","Type":"ContainerStarted","Data":"46130497623e8af7d12c09466bca849e12d5de9f69f8a59ed816d6afaa9e6b01"}
Sep 06 10:22:54.231212 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.230931    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gdhpd" event={"ID":"77c1dc1a-0efd-4422-842c-c630206d37a0","Type":"ContainerStarted","Data":"20bb296a1c404835e7991f9bb7890599e88378730f157e1e2564bdd629b36888"}
Sep 06 10:22:54.231539 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.231487    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:22:54.233162 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.233140    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6prgq" event={"ID":"705da257-7931-44ef-89b4-070ba34f4cb0","Type":"ContainerStarted","Data":"e9bf68c568a3ae03ea7500e996fa7e24e1bd6090f922899bf2b4a39626799728"}
Sep 06 10:22:54.234205 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.234147    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:22:54.252069 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.247803    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gdhpd" podStartSLOduration=65.247784692 podStartE2EDuration="1m5.247784692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:21:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:54.244025675 +0000 UTC m=+66.022445099" watchObservedRunningTime="2026-09-06 10:22:54.247784692 +0000 UTC m=+66.026204105"
Sep 06 10:22:54.430250 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.430227    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f899d8c59-htkf6"]
Sep 06 10:22:54.432417 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:22:54.432388    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5bcfaad_879c_4173_816a_63ddf0252bec.slice/crio-29c1af293e188a487fba5afb3b6992823d31931b223f8522551153dd5aeff822 WatchSource:0}: Error finding container 29c1af293e188a487fba5afb3b6992823d31931b223f8522551153dd5aeff822: Status 404 returned error can't find the container with id 29c1af293e188a487fba5afb3b6992823d31931b223f8522551153dd5aeff822
Sep 06 10:22:54.464297 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.464270    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-8ljwg"]
Sep 06 10:22:54.485221 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:22:54.485199    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd4b7d8_718f_4d1d_95b8_87e0d2a0f822.slice/crio-141ea48102a0dbed0f1262368a72992f0c2dcc2301f30896f26ed40084614c34 WatchSource:0}: Error finding container 141ea48102a0dbed0f1262368a72992f0c2dcc2301f30896f26ed40084614c34: Status 404 returned error can't find the container with id 141ea48102a0dbed0f1262368a72992f0c2dcc2301f30896f26ed40084614c34
Sep 06 10:22:54.506240 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.506219    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn"]
Sep 06 10:22:54.511260 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:22:54.511236    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a7404c4_4386_4f2d_aa64_ea0622b6d073.slice/crio-f9ecb1c5e052659f55a02bb6108806631a92e254eec175fb39d3964494fce30d WatchSource:0}: Error finding container f9ecb1c5e052659f55a02bb6108806631a92e254eec175fb39d3964494fce30d: Status 404 returned error can't find the container with id f9ecb1c5e052659f55a02bb6108806631a92e254eec175fb39d3964494fce30d
Sep 06 10:22:54.534158 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.534134    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh"]
Sep 06 10:22:54.547216 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.547185    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zzn8f"]
Sep 06 10:22:54.550301 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:22:54.550278    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9689b0e_8830_4c94_befb_3c64ef549feb.slice/crio-1de6033b3ee0250d5d8d839fe26c525f372f88a2f64069249d4bf6103be22a2f WatchSource:0}: Error finding container 1de6033b3ee0250d5d8d839fe26c525f372f88a2f64069249d4bf6103be22a2f: Status 404 returned error can't find the container with id 1de6033b3ee0250d5d8d839fe26c525f372f88a2f64069249d4bf6103be22a2f
Sep 06 10:22:54.578712 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:54.578696    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-66bc586b4-fkkkm"]
Sep 06 10:22:54.580898 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:22:54.580877    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1056410a_6c66_44ab_b62e_8e2046b73703.slice/crio-33419b2d3cce1304d3b0cd49074f17844e53889a9582524ad8e3f88674aa530f WatchSource:0}: Error finding container 33419b2d3cce1304d3b0cd49074f17844e53889a9582524ad8e3f88674aa530f: Status 404 returned error can't find the container with id 33419b2d3cce1304d3b0cd49074f17844e53889a9582524ad8e3f88674aa530f
Sep 06 10:22:55.239042 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:55.238998    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh" event={"ID":"f8e77ae8-b076-4ca5-9c4a-e433e6fac236","Type":"ContainerStarted","Data":"82acd4a5fed40eaf3acd42ff70b70f44c686d1488119d2bc4c6496201ee409db"}
Sep 06 10:22:55.241510 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:55.241477    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-66bc586b4-fkkkm" event={"ID":"1056410a-6c66-44ab-b62e-8e2046b73703","Type":"ContainerStarted","Data":"258ecdbaad521a70cc6e0c4828a6abbef19babdb480acfd74b36882b1a997f0a"}
Sep 06 10:22:55.241653 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:55.241528    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-66bc586b4-fkkkm" event={"ID":"1056410a-6c66-44ab-b62e-8e2046b73703","Type":"ContainerStarted","Data":"33419b2d3cce1304d3b0cd49074f17844e53889a9582524ad8e3f88674aa530f"}
Sep 06 10:22:55.245619 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:55.244820    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f899d8c59-htkf6" event={"ID":"d5bcfaad-879c-4173-816a-63ddf0252bec","Type":"ContainerStarted","Data":"46ba08c13234910ab7e31faf18e20ac29185c493284fb58aacea85de14dc01b9"}
Sep 06 10:22:55.245619 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:55.244870    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f899d8c59-htkf6" event={"ID":"d5bcfaad-879c-4173-816a-63ddf0252bec","Type":"ContainerStarted","Data":"29c1af293e188a487fba5afb3b6992823d31931b223f8522551153dd5aeff822"}
Sep 06 10:22:55.245619 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:55.245407    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:22:55.250371 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:55.250343    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zzn8f" event={"ID":"f9689b0e-8830-4c94-befb-3c64ef549feb","Type":"ContainerStarted","Data":"1de6033b3ee0250d5d8d839fe26c525f372f88a2f64069249d4bf6103be22a2f"}
Sep 06 10:22:55.252314 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:55.252289    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn" event={"ID":"5a7404c4-4386-4f2d-aa64-ea0622b6d073","Type":"ContainerStarted","Data":"f9ecb1c5e052659f55a02bb6108806631a92e254eec175fb39d3964494fce30d"}
Sep 06 10:22:55.254475 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:55.254454    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-8ljwg" event={"ID":"4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822","Type":"ContainerStarted","Data":"141ea48102a0dbed0f1262368a72992f0c2dcc2301f30896f26ed40084614c34"}
Sep 06 10:22:55.262407 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:55.262360    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-66bc586b4-fkkkm" podStartSLOduration=48.262348026 podStartE2EDuration="48.262348026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:22:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:55.260554131 +0000 UTC m=+67.038973557" watchObservedRunningTime="2026-09-06 10:22:55.262348026 +0000 UTC m=+67.040767436"
Sep 06 10:22:55.278813 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:55.278756    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f899d8c59-htkf6" podStartSLOduration=66.278743257 podStartE2EDuration="1m6.278743257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:21:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:22:55.277880359 +0000 UTC m=+67.056299774" watchObservedRunningTime="2026-09-06 10:22:55.278743257 +0000 UTC m=+67.057162671"
Sep 06 10:22:55.760983 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:55.760888    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:55.843025 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:55.842993    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:55.942917 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:55.942876    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:56.040772 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:56.040694    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:56.212067 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:56.212035    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:56.214988 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:56.214930    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:56.259197 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:56.259159    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:56.260439 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:56.260415    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-66bc586b4-fkkkm"
Sep 06 10:22:57.748410 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:57.748380    2561 scope.go:117] "RemoveContainer" containerID="cfbc8006ebc80fefe1ceade9d272439e5823a1509591ccf66065ca62c349d8e0"
Sep 06 10:22:58.770110 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:58.770076    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:58.881365 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:58.881331    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:59.703173 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:59.703121    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:59.797284 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:59.797196    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:59.890925 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:59.890891    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:22:59.994457 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:22:59.994423    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:00.090881 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.090805    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:00.191606 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.191575    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:00.275724 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.275697    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/1.log"
Sep 06 10:23:00.275885 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.275779    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-fgtkf" event={"ID":"dfee3641-093e-47c4-bb89-51a039ac335c","Type":"ContainerStarted","Data":"c70e394336085f4bec2aaa13993e9dcfaf676028eb0d2c9ebfea7c24f0b81611"}
Sep 06 10:23:00.276086 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.276063    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-fgtkf"
Sep 06 10:23:00.277769 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.277743    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6prgq" event={"ID":"705da257-7931-44ef-89b4-070ba34f4cb0","Type":"ContainerStarted","Data":"dacae154314c77f3beac00db1ccd5fb4f458df08c73c49fa2da13a6608b8795a"}
Sep 06 10:23:00.277885 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.277795    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6prgq" event={"ID":"705da257-7931-44ef-89b4-070ba34f4cb0","Type":"ContainerStarted","Data":"ba4449fa885e1a901453c0e18441b2a31aeb68c63c8183ae0f258dad6086d418"}
Sep 06 10:23:00.279591 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.279558    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh" event={"ID":"f8e77ae8-b076-4ca5-9c4a-e433e6fac236","Type":"ContainerStarted","Data":"631ff62b07cc9eac2af5a82db3c4362cac68b30f93c811028996fe8d824d1ab6"}
Sep 06 10:23:00.279708 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.279600    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh" event={"ID":"f8e77ae8-b076-4ca5-9c4a-e433e6fac236","Type":"ContainerStarted","Data":"95975486b8f6e1fb7d8936f19f02024488a2fc7db79ab692bc20d1de804a9151"}
Sep 06 10:23:00.281128 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.281101    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nkc66" event={"ID":"4ff152b4-4c19-4c64-af60-41eeb9cbb81e","Type":"ContainerStarted","Data":"dcde76375b9e0dbac7357007e88676a0f8ce49fd1937c363caff2705f5120ac7"}
Sep 06 10:23:00.281844 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.281820    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-fgtkf"
Sep 06 10:23:00.282912 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.282895    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zzn8f" event={"ID":"f9689b0e-8830-4c94-befb-3c64ef549feb","Type":"ContainerStarted","Data":"e2bd1e997553764454be5aa1694aefd0f2d497b237c5ff2f0f1da14f0059f670"}
Sep 06 10:23:00.282994 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.282927    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zzn8f" event={"ID":"f9689b0e-8830-4c94-befb-3c64ef549feb","Type":"ContainerStarted","Data":"2ef263767de739026f757330e5efd6e654c77b3aa0cb7e3b9f6f6d7ddb66ff00"}
Sep 06 10:23:00.282994 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.282986    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:23:00.284375 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.284354    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn" event={"ID":"5a7404c4-4386-4f2d-aa64-ea0622b6d073","Type":"ContainerStarted","Data":"f1438892f07305fc94204af82d39742f8fe5a3e5c51da7632ad1568b4d3068df"}
Sep 06 10:23:00.285633 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.285616    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-8ljwg" event={"ID":"4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822","Type":"ContainerStarted","Data":"cd190e2633ca80c36b2d5af0a026e871937be3c7b0875eb5f9b0b76e238e8ce8"}
Sep 06 10:23:00.292671 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.292634    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-fgtkf" podStartSLOduration=42.888138488 podStartE2EDuration="52.292622761s" totalImagesPullingTime="9.404484273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:23:00.292236921 +0000 UTC m=+72.070656333" watchObservedRunningTime="2026-09-06 10:23:00.292622761 +0000 UTC m=+72.071042164"
Sep 06 10:23:00.296368 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.296349    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:00.309371 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.309313    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6prgq" podStartSLOduration=66.190694193 podStartE2EDuration="1m11.309299791s" totalImagesPullingTime="5.118605598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:23:00.308335979 +0000 UTC m=+72.086755382" watchObservedRunningTime="2026-09-06 10:23:00.309299791 +0000 UTC m=+72.087719245"
Sep 06 10:23:00.326396 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.326350    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-8ljwg" podStartSLOduration=48.567293447 podStartE2EDuration="53.326335837s" totalImagesPullingTime="4.75904239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:23:00.325070316 +0000 UTC m=+72.103489728" watchObservedRunningTime="2026-09-06 10:23:00.326335837 +0000 UTC m=+72.104755241"
Sep 06 10:23:00.342844 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.342756    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-c4fdh" podStartSLOduration=47.681258733 podStartE2EDuration="52.34273638s" totalImagesPullingTime="4.661477647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:23:00.341659587 +0000 UTC m=+72.120079000" watchObservedRunningTime="2026-09-06 10:23:00.34273638 +0000 UTC m=+72.121155794"
Sep 06 10:23:00.384829 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.384782    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-jpxdn" podStartSLOduration=48.647809716 podStartE2EDuration="53.384765858s" totalImagesPullingTime="4.736956142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:23:00.38397907 +0000 UTC m=+72.162398484" watchObservedRunningTime="2026-09-06 10:23:00.384765858 +0000 UTC m=+72.163185273"
Sep 06 10:23:00.384965 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.384893    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nkc66" podStartSLOduration=66.1705885 podStartE2EDuration="1m11.384889136s" totalImagesPullingTime="5.214300636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 10:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:23:00.362040094 +0000 UTC m=+72.140459509" watchObservedRunningTime="2026-09-06 10:23:00.384889136 +0000 UTC m=+72.163308550"
Sep 06 10:23:00.392725 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.392699    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:00.404232 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.404190    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zzn8f" podStartSLOduration=33.698657609 podStartE2EDuration="38.404176162s" totalImagesPullingTime="4.705518553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:22:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:23:00.402228203 +0000 UTC m=+72.180647618" watchObservedRunningTime="2026-09-06 10:23:00.404176162 +0000 UTC m=+72.182595615"
Sep 06 10:23:00.463186 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.463157    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:00.563908 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.563871    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:00.618728 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.618658    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:00.780370 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.780342    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:00.833062 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:00.833031    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:01.005309 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:01.005282    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:01.063588 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:01.063559    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:01.296611 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:01.296536    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:01.398528 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:01.398489    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:01.499689 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:01.499646    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:01.791069 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:01.791042    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:01.986019 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:01.985975    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:02.089715 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:02.089644    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:02.801678 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:02.801643    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:05.880768 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:05.880731    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:05.955534 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:05.955502    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:06.367211 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:06.367179    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:08.442714 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:08.442681    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:09.023072 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.023043    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59f7c4fc77-65rbl"]
Sep 06 10:23:09.026364 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.026344    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:09.029714 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.029689    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 06 10:23:09.029870 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.029717    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 06 10:23:09.029870 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.029722    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 06 10:23:09.030052 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.029737    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kljff\""
Sep 06 10:23:09.030052 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.029739    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 06 10:23:09.030052 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.029744    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 06 10:23:09.030052 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.029803    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 06 10:23:09.030052 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.029805    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 06 10:23:09.038015 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.037986    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f7c4fc77-65rbl"]
Sep 06 10:23:09.103302 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.103274    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c635862e-8355-4312-ba8b-2fcba2bd6649-oauth-serving-cert\") pod \"console-59f7c4fc77-65rbl\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") " pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:09.103473 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.103389    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c635862e-8355-4312-ba8b-2fcba2bd6649-console-oauth-config\") pod \"console-59f7c4fc77-65rbl\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") " pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:09.103473 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.103414    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlgqs\" (UniqueName: \"kubernetes.io/projected/c635862e-8355-4312-ba8b-2fcba2bd6649-kube-api-access-xlgqs\") pod \"console-59f7c4fc77-65rbl\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") " pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:09.103588 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.103495    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c635862e-8355-4312-ba8b-2fcba2bd6649-service-ca\") pod \"console-59f7c4fc77-65rbl\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") " pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:09.103588 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.103526    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c635862e-8355-4312-ba8b-2fcba2bd6649-console-config\") pod \"console-59f7c4fc77-65rbl\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") " pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:09.103588 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.103564    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c635862e-8355-4312-ba8b-2fcba2bd6649-console-serving-cert\") pod \"console-59f7c4fc77-65rbl\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") " pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:09.204115 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.204081    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c635862e-8355-4312-ba8b-2fcba2bd6649-console-oauth-config\") pod \"console-59f7c4fc77-65rbl\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") " pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:09.204115 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.204113    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlgqs\" (UniqueName: \"kubernetes.io/projected/c635862e-8355-4312-ba8b-2fcba2bd6649-kube-api-access-xlgqs\") pod \"console-59f7c4fc77-65rbl\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") " pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:09.204345 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.204140    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c635862e-8355-4312-ba8b-2fcba2bd6649-service-ca\") pod \"console-59f7c4fc77-65rbl\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") " pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:09.204409 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.204362    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c635862e-8355-4312-ba8b-2fcba2bd6649-console-config\") pod \"console-59f7c4fc77-65rbl\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") " pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:09.204464 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.204418    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c635862e-8355-4312-ba8b-2fcba2bd6649-console-serving-cert\") pod \"console-59f7c4fc77-65rbl\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") " pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:09.204464 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.204454    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c635862e-8355-4312-ba8b-2fcba2bd6649-oauth-serving-cert\") pod \"console-59f7c4fc77-65rbl\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") " pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:09.204884 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.204859    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c635862e-8355-4312-ba8b-2fcba2bd6649-service-ca\") pod \"console-59f7c4fc77-65rbl\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") " pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:09.204996 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.204958    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c635862e-8355-4312-ba8b-2fcba2bd6649-console-config\") pod \"console-59f7c4fc77-65rbl\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") " pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:09.205140 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.205115    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c635862e-8355-4312-ba8b-2fcba2bd6649-oauth-serving-cert\") pod \"console-59f7c4fc77-65rbl\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") " pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:09.206706 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.206675    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c635862e-8355-4312-ba8b-2fcba2bd6649-console-oauth-config\") pod \"console-59f7c4fc77-65rbl\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") " pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:09.206786 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.206712    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c635862e-8355-4312-ba8b-2fcba2bd6649-console-serving-cert\") pod \"console-59f7c4fc77-65rbl\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") " pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:09.215172 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.213132    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlgqs\" (UniqueName: \"kubernetes.io/projected/c635862e-8355-4312-ba8b-2fcba2bd6649-kube-api-access-xlgqs\") pod \"console-59f7c4fc77-65rbl\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") " pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:09.336067 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.335963    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:09.608911 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:09.608886    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59f7c4fc77-65rbl"]
Sep 06 10:23:09.611166 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:23:09.611133    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc635862e_8355_4312_ba8b_2fcba2bd6649.slice/crio-7ac8b7a4ad88a8d9467914191835be17f3cb675acef3a8c542ce3885984a7865 WatchSource:0}: Error finding container 7ac8b7a4ad88a8d9467914191835be17f3cb675acef3a8c542ce3885984a7865: Status 404 returned error can't find the container with id 7ac8b7a4ad88a8d9467914191835be17f3cb675acef3a8c542ce3885984a7865
Sep 06 10:23:10.044307 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.044277    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:10.259951 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.259924    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:10.292919 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.292882    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zzn8f"
Sep 06 10:23:10.321189 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.321121    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z6v4s"]
Sep 06 10:23:10.324705 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.324676    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.325032 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.324982    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f7c4fc77-65rbl" event={"ID":"c635862e-8355-4312-ba8b-2fcba2bd6649","Type":"ContainerStarted","Data":"7ac8b7a4ad88a8d9467914191835be17f3cb675acef3a8c542ce3885984a7865"}
Sep 06 10:23:10.327379 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.327361    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 06 10:23:10.327541 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.327364    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fsv89\""
Sep 06 10:23:10.327898 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.327645    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 06 10:23:10.327898 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.327756    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 06 10:23:10.327898 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.327874    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 06 10:23:10.355909 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.355883    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:10.415898 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.415865    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-tls\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.416054 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.415910    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-textfile\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.416054 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.415953    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0195966b-d760-40b3-8952-25fb4edbea0f-metrics-client-ca\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.416054 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.415976    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-wtmp\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.416054 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.416020    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0195966b-d760-40b3-8952-25fb4edbea0f-sys\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.416054 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.416044    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-accelerators-collector-config\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.416354 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.416073    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28jkd\" (UniqueName: \"kubernetes.io/projected/0195966b-d760-40b3-8952-25fb4edbea0f-kube-api-access-28jkd\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.416354 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.416137    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0195966b-d760-40b3-8952-25fb4edbea0f-root\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.416354 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.416159    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.422770 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.422736    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:10.517334 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.517285    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0195966b-d760-40b3-8952-25fb4edbea0f-root\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.517523 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.517359    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.517523 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.517398    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-tls\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.517523 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.517407    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0195966b-d760-40b3-8952-25fb4edbea0f-root\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.517523 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.517438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-textfile\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.517523 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.517478    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0195966b-d760-40b3-8952-25fb4edbea0f-metrics-client-ca\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.517523 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.517506    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-wtmp\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.517801 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:23:10.517536    2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 06 10:23:10.517801 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.517551    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0195966b-d760-40b3-8952-25fb4edbea0f-sys\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.517801 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.517578    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-accelerators-collector-config\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.517801 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:23:10.517613    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-tls podName:0195966b-d760-40b3-8952-25fb4edbea0f nodeName:}" failed. No retries permitted until 2026-09-06 10:23:11.017592835 +0000 UTC m=+82.796012235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-tls") pod "node-exporter-z6v4s" (UID: "0195966b-d760-40b3-8952-25fb4edbea0f") : secret "node-exporter-tls" not found
Sep 06 10:23:10.517801 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.517646    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28jkd\" (UniqueName: \"kubernetes.io/projected/0195966b-d760-40b3-8952-25fb4edbea0f-kube-api-access-28jkd\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.517956 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.517830    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-textfile\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.517956 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.517943    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-wtmp\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.518017 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.517997    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0195966b-d760-40b3-8952-25fb4edbea0f-sys\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.518209 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.518188    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-accelerators-collector-config\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.518315 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.518289    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0195966b-d760-40b3-8952-25fb4edbea0f-metrics-client-ca\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.520241 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.520218    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.530418 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.530388    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28jkd\" (UniqueName: \"kubernetes.io/projected/0195966b-d760-40b3-8952-25fb4edbea0f-kube-api-access-28jkd\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:10.542826 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.542795    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:10.644049 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.643956    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:10.748400 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.748368    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:10.845080 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:10.845042    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:11.021786 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.021656    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-tls\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:11.021972 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:23:11.021811    2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 06 10:23:11.021972 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:23:11.021884    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-tls podName:0195966b-d760-40b3-8952-25fb4edbea0f nodeName:}" failed. No retries permitted until 2026-09-06 10:23:12.021862228 +0000 UTC m=+83.800281634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-tls") pod "node-exporter-z6v4s" (UID: "0195966b-d760-40b3-8952-25fb4edbea0f") : secret "node-exporter-tls" not found
Sep 06 10:23:11.196397 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.196366    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:11.298959 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.298867    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:11.348192 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.348163    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 10:23:11.353317 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.353289    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.355830 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.355532    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 06 10:23:11.355830 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.355596    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2ff7c\""
Sep 06 10:23:11.355830 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.355672    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 06 10:23:11.355830 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.355772    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 06 10:23:11.356137 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.355891    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 06 10:23:11.356137 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.355939    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 06 10:23:11.356137 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.356092    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 06 10:23:11.356288 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.356175    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 06 10:23:11.356508 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.356490    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 06 10:23:11.356588 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.356510    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 06 10:23:11.367888 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.367865    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 10:23:11.370291 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.370266    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:11.426435 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.426404    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.426609 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.426453    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2a55c8e5-db73-4bd8-85b9-5965720f51ac-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.426609 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.426514    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.426609 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.426539    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-web-config\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.426609 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.426565    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a55c8e5-db73-4bd8-85b9-5965720f51ac-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.426800 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.426619    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a55c8e5-db73-4bd8-85b9-5965720f51ac-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.426800 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.426678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jff2h\" (UniqueName: \"kubernetes.io/projected/2a55c8e5-db73-4bd8-85b9-5965720f51ac-kube-api-access-jff2h\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.426800 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.426713    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.426800 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.426753    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.426800 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.426780    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-config-volume\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.427121 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.426803    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a55c8e5-db73-4bd8-85b9-5965720f51ac-config-out\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.427121 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.426883    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a55c8e5-db73-4bd8-85b9-5965720f51ac-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.427121 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.426945    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.460810 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.460773    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:11.528342 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.528288    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a55c8e5-db73-4bd8-85b9-5965720f51ac-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.528527 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.528358    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.528527 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.528410    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.528527 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.528437    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2a55c8e5-db73-4bd8-85b9-5965720f51ac-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.528695 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.528558    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.528695 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.528609    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-web-config\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.528695 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.528638    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a55c8e5-db73-4bd8-85b9-5965720f51ac-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.528695 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.528669    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a55c8e5-db73-4bd8-85b9-5965720f51ac-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.528895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.528717    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jff2h\" (UniqueName: \"kubernetes.io/projected/2a55c8e5-db73-4bd8-85b9-5965720f51ac-kube-api-access-jff2h\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.528895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.528757    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.528895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.528786    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.528895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.528815    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2a55c8e5-db73-4bd8-85b9-5965720f51ac-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.528895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.528819    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-config-volume\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.528895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.528867    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a55c8e5-db73-4bd8-85b9-5965720f51ac-config-out\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.529199 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.529140    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a55c8e5-db73-4bd8-85b9-5965720f51ac-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.530260 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.530232    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a55c8e5-db73-4bd8-85b9-5965720f51ac-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.532869 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.532836    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a55c8e5-db73-4bd8-85b9-5965720f51ac-config-out\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.533190 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.533167    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-config-volume\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.533851 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.533803    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.533950 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.533916    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.534745 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.534305    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.534745 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.534699    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-web-config\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.534890 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.534750    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.534994 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.534958    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.535637 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.535616    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a55c8e5-db73-4bd8-85b9-5965720f51ac-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.537062 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.537041    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jff2h\" (UniqueName: \"kubernetes.io/projected/2a55c8e5-db73-4bd8-85b9-5965720f51ac-kube-api-access-jff2h\") pod \"alertmanager-main-0\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:11.665127 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:11.665093    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:23:12.034126 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:12.033647    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-tls\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:12.036513 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:12.036484    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0195966b-d760-40b3-8952-25fb4edbea0f-node-exporter-tls\") pod \"node-exporter-z6v4s\" (UID: \"0195966b-d760-40b3-8952-25fb4edbea0f\") " pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:12.137484 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:12.137444    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z6v4s"
Sep 06 10:23:12.491084 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:23:12.491041    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0195966b_d760_40b3_8952_25fb4edbea0f.slice/crio-e191ac42ca28c2f3e694ddd47d4f763e42f562d7f730e596307dcf1a7a949a1e WatchSource:0}: Error finding container e191ac42ca28c2f3e694ddd47d4f763e42f562d7f730e596307dcf1a7a949a1e: Status 404 returned error can't find the container with id e191ac42ca28c2f3e694ddd47d4f763e42f562d7f730e596307dcf1a7a949a1e
Sep 06 10:23:12.761910 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:12.761804    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 10:23:12.764070 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:23:12.764041    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a55c8e5_db73_4bd8_85b9_5965720f51ac.slice/crio-9e4b4f1cac78df078c3d0c2198eaf36057b055c0af7e3b57d02869c84d569a6d WatchSource:0}: Error finding container 9e4b4f1cac78df078c3d0c2198eaf36057b055c0af7e3b57d02869c84d569a6d: Status 404 returned error can't find the container with id 9e4b4f1cac78df078c3d0c2198eaf36057b055c0af7e3b57d02869c84d569a6d
Sep 06 10:23:13.239931 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:13.239899    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:13.339020 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:13.338989    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a55c8e5-db73-4bd8-85b9-5965720f51ac","Type":"ContainerStarted","Data":"9e4b4f1cac78df078c3d0c2198eaf36057b055c0af7e3b57d02869c84d569a6d"}
Sep 06 10:23:13.340682 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:13.340644    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f7c4fc77-65rbl" event={"ID":"c635862e-8355-4312-ba8b-2fcba2bd6649","Type":"ContainerStarted","Data":"b80a70ecc746bb4295e38250927317487f0c17240e8b7cebc996ca45c934014f"}
Sep 06 10:23:13.341446 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:13.341419    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:13.341939 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:13.341913    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z6v4s" event={"ID":"0195966b-d760-40b3-8952-25fb4edbea0f","Type":"ContainerStarted","Data":"e191ac42ca28c2f3e694ddd47d4f763e42f562d7f730e596307dcf1a7a949a1e"}
Sep 06 10:23:13.359478 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:13.359437    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59f7c4fc77-65rbl" podStartSLOduration=1.43502443 podStartE2EDuration="4.359422822s" totalImagesPullingTime="2.924398392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:23:13.357936529 +0000 UTC m=+85.136355943" watchObservedRunningTime="2026-09-06 10:23:13.359422822 +0000 UTC m=+85.137842235"
Sep 06 10:23:13.512981 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:13.512897    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:13.666648 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:13.666617    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:14.006091 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:14.006066    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:14.149285 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:14.149249    2561 patch_prober.go:28] interesting pod/image-registry-6f899d8c59-htkf6 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 06 10:23:14.149452 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:14.149306    2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6f899d8c59-htkf6" podUID="d5bcfaad-879c-4173-816a-63ddf0252bec" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 10:23:14.347255 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:14.347166    2561 generic.go:356] "Generic (PLEG): container finished" podID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerID="cca8df210968811786f58c0a58fd2adf8d89083fe4cb8af18bc5a830c51b5e33" exitCode=0
Sep 06 10:23:14.347439 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:14.347248    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a55c8e5-db73-4bd8-85b9-5965720f51ac","Type":"ContainerDied","Data":"cca8df210968811786f58c0a58fd2adf8d89083fe4cb8af18bc5a830c51b5e33"}
Sep 06 10:23:14.349077 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:14.349058    2561 generic.go:356] "Generic (PLEG): container finished" podID="0195966b-d760-40b3-8952-25fb4edbea0f" containerID="8c72a30e3b4b102da4e190bdf98014b10bb811807386b9d54108ad01417c5ecd" exitCode=0
Sep 06 10:23:14.349165 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:14.349143    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z6v4s" event={"ID":"0195966b-d760-40b3-8952-25fb4edbea0f","Type":"ContainerDied","Data":"8c72a30e3b4b102da4e190bdf98014b10bb811807386b9d54108ad01417c5ecd"}
Sep 06 10:23:14.814774 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:14.814740    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:15.054502 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.054465    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:15.119229 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.119151    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:15.356499 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.356462    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z6v4s" event={"ID":"0195966b-d760-40b3-8952-25fb4edbea0f","Type":"ContainerStarted","Data":"8c890ac1c2e4f99891fe18323bc5d3acc5a9bdc06d83017f4d19a3124cea92af"}
Sep 06 10:23:15.356736 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.356558    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z6v4s" event={"ID":"0195966b-d760-40b3-8952-25fb4edbea0f","Type":"ContainerStarted","Data":"95209513b635b72d703a3aabf0cb066ebbbd72cd50893b4962f7e157faef38e4"}
Sep 06 10:23:15.375477 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.375377    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z6v4s" podStartSLOduration=4.511104508 podStartE2EDuration="5.375360633s" totalImagesPullingTime="799.579044ms" totalInitContainerRuntime="64.677081ms" isStatefulPod=true podCreationTimestamp="2026-09-06 10:23:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:23:15.374252243 +0000 UTC m=+87.152671657" watchObservedRunningTime="2026-09-06 10:23:15.375360633 +0000 UTC m=+87.153780048"
Sep 06 10:23:15.506094 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.506063    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-799d47dff5-c7hmg"]
Sep 06 10:23:15.511156 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.511134    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.513691 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.513663    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 06 10:23:15.513822 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.513685    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 06 10:23:15.513822 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.513690    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 06 10:23:15.513822 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.513757    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 06 10:23:15.514140 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.514110    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 06 10:23:15.514332 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.514304    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-sxq4d\""
Sep 06 10:23:15.517814 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.517795    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 06 10:23:15.526585 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.526559    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-799d47dff5-c7hmg"]
Sep 06 10:23:15.665795 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.665766    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:15.666846 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.666823    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c213b88-a001-45d0-b9c4-d92b590a730a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.666972 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.666862    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c213b88-a001-45d0-b9c4-d92b590a730a-metrics-client-ca\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.666972 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.666886    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9c213b88-a001-45d0-b9c4-d92b590a730a-federate-client-tls\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.667111 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.666975    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c213b88-a001-45d0-b9c4-d92b590a730a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.667111 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.667020    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9c213b88-a001-45d0-b9c4-d92b590a730a-secret-telemeter-client\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.667111 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.667068    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9c213b88-a001-45d0-b9c4-d92b590a730a-telemeter-client-tls\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.667111 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.667093    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlqzb\" (UniqueName: \"kubernetes.io/projected/9c213b88-a001-45d0-b9c4-d92b590a730a-kube-api-access-hlqzb\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.667277 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.667188    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c213b88-a001-45d0-b9c4-d92b590a730a-serving-certs-ca-bundle\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.768549 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.768511    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c213b88-a001-45d0-b9c4-d92b590a730a-serving-certs-ca-bundle\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.768707 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.768571    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c213b88-a001-45d0-b9c4-d92b590a730a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.768707 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.768611    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c213b88-a001-45d0-b9c4-d92b590a730a-metrics-client-ca\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.768707 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.768646    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9c213b88-a001-45d0-b9c4-d92b590a730a-federate-client-tls\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.768707 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.768688    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c213b88-a001-45d0-b9c4-d92b590a730a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.768867 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.768722    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9c213b88-a001-45d0-b9c4-d92b590a730a-secret-telemeter-client\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.768867 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.768739    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9c213b88-a001-45d0-b9c4-d92b590a730a-telemeter-client-tls\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.768867 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.768758    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlqzb\" (UniqueName: \"kubernetes.io/projected/9c213b88-a001-45d0-b9c4-d92b590a730a-kube-api-access-hlqzb\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.769400 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.769350    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c213b88-a001-45d0-b9c4-d92b590a730a-serving-certs-ca-bundle\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.769400 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.769391    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9c213b88-a001-45d0-b9c4-d92b590a730a-metrics-client-ca\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.769921 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.769874    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c213b88-a001-45d0-b9c4-d92b590a730a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.771728 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.771698    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9c213b88-a001-45d0-b9c4-d92b590a730a-secret-telemeter-client\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.771879 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.771792    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9c213b88-a001-45d0-b9c4-d92b590a730a-federate-client-tls\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.771962 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.771943    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9c213b88-a001-45d0-b9c4-d92b590a730a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.772225 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.772196    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9c213b88-a001-45d0-b9c4-d92b590a730a-telemeter-client-tls\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.777128 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.777102    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlqzb\" (UniqueName: \"kubernetes.io/projected/9c213b88-a001-45d0-b9c4-d92b590a730a-kube-api-access-hlqzb\") pod \"telemeter-client-799d47dff5-c7hmg\" (UID: \"9c213b88-a001-45d0-b9c4-d92b590a730a\") " pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:15.823460 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:15.823432    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg"
Sep 06 10:23:16.122231 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:16.122203    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-799d47dff5-c7hmg"]
Sep 06 10:23:16.127256 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:23:16.127230    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c213b88_a001_45d0_b9c4_d92b590a730a.slice/crio-a47ba00514edbefbc4f55807d415a796b4ebb1268c9a188a51cf097bd82e0b91 WatchSource:0}: Error finding container a47ba00514edbefbc4f55807d415a796b4ebb1268c9a188a51cf097bd82e0b91: Status 404 returned error can't find the container with id a47ba00514edbefbc4f55807d415a796b4ebb1268c9a188a51cf097bd82e0b91
Sep 06 10:23:16.364570 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:16.364537    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a55c8e5-db73-4bd8-85b9-5965720f51ac","Type":"ContainerStarted","Data":"c6f50cbd7f13fb680330f9902d2225e5f00aa956d94faf20472b6dc746f8ed42"}
Sep 06 10:23:16.364739 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:16.364617    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a55c8e5-db73-4bd8-85b9-5965720f51ac","Type":"ContainerStarted","Data":"7310581d36d44487921abf928c9501faf79ea755b4664993aa23650bfe996e7c"}
Sep 06 10:23:16.364739 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:16.364656    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a55c8e5-db73-4bd8-85b9-5965720f51ac","Type":"ContainerStarted","Data":"578b5c0694164038524faa0fa347709dc459fd929a3ae0f5839fcb72934de81d"}
Sep 06 10:23:16.364739 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:16.364695    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a55c8e5-db73-4bd8-85b9-5965720f51ac","Type":"ContainerStarted","Data":"201637c4fee9b562554b0b6a2e726a585d0610fd4634ade4a40f8b1dfcd4d319"}
Sep 06 10:23:16.364739 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:16.364732    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a55c8e5-db73-4bd8-85b9-5965720f51ac","Type":"ContainerStarted","Data":"13d4dc64b8056ab8132b4746e60767213fe9acb47bc9c8712ccfaa07d8bbd127"}
Sep 06 10:23:16.365905 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:16.365875    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg" event={"ID":"9c213b88-a001-45d0-b9c4-d92b590a730a","Type":"ContainerStarted","Data":"a47ba00514edbefbc4f55807d415a796b4ebb1268c9a188a51cf097bd82e0b91"}
Sep 06 10:23:16.372416 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:16.372393    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:16.459860 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:16.459790    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:16.527364 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:16.527312    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:16.597808 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:16.597775    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:17.267087 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:17.267060    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:23:17.374372 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:17.374267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a55c8e5-db73-4bd8-85b9-5965720f51ac","Type":"ContainerStarted","Data":"246385f9e5438f59f1ef0610714854cd64cc3f60b3b99b4b5213b7c93a925109"}
Sep 06 10:23:17.399506 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:17.399407    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.836880816 podStartE2EDuration="6.399386417s" totalImagesPullingTime="3.546027365s" totalInitContainerRuntime="16.478236ms" isStatefulPod=false podCreationTimestamp="2026-09-06 10:23:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:23:17.398290854 +0000 UTC m=+89.176710278" watchObservedRunningTime="2026-09-06 10:23:17.399386417 +0000 UTC m=+89.177805827"
Sep 06 10:23:17.433168 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:17.433128    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:17.527436 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:17.527399    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:18.208484 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.208401    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-784f899497-rpg4x"]
Sep 06 10:23:18.211680 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.211653    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.218147 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.218065    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 06 10:23:18.222196 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.222172    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-784f899497-rpg4x"]
Sep 06 10:23:18.290826 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.290802    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-console-config\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.291129 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.290838    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6385f70c-ceb6-4688-90ef-179c7678017c-console-serving-cert\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.291129 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.290890    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-trusted-ca-bundle\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.291129 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.290945    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-oauth-serving-cert\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.291129 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.290967    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdzbz\" (UniqueName: \"kubernetes.io/projected/6385f70c-ceb6-4688-90ef-179c7678017c-kube-api-access-jdzbz\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.291129 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.290995    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-service-ca\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.291129 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.291035    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6385f70c-ceb6-4688-90ef-179c7678017c-console-oauth-config\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.372360 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.372315    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f899d8c59-htkf6"]
Sep 06 10:23:18.381241 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.381213    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg" event={"ID":"9c213b88-a001-45d0-b9c4-d92b590a730a","Type":"ContainerStarted","Data":"630e37c7019d2075e63088160d81dd8ccf73e85b0f35af3dfac2c48063c16db1"}
Sep 06 10:23:18.381386 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.381272    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg" event={"ID":"9c213b88-a001-45d0-b9c4-d92b590a730a","Type":"ContainerStarted","Data":"864c058db7aa40d29c3f342794cd090e980cb3d44e9f3822fa91611600a07932"}
Sep 06 10:23:18.381386 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.381296    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg" event={"ID":"9c213b88-a001-45d0-b9c4-d92b590a730a","Type":"ContainerStarted","Data":"8b0228be6546cf9f697d1699b97f4b40b2933ea07ec163dcb39525d44a7599c3"}
Sep 06 10:23:18.392172 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.392149    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-trusted-ca-bundle\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.392252 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.392193    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-oauth-serving-cert\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.392252 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.392217    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdzbz\" (UniqueName: \"kubernetes.io/projected/6385f70c-ceb6-4688-90ef-179c7678017c-kube-api-access-jdzbz\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.392356 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.392252    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-service-ca\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.392356 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.392308    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6385f70c-ceb6-4688-90ef-179c7678017c-console-oauth-config\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.392462 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.392372    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-console-config\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.392462 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.392417    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6385f70c-ceb6-4688-90ef-179c7678017c-console-serving-cert\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.392938 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.392918    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-oauth-serving-cert\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.393194 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.393133    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-trusted-ca-bundle\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.393194 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.393137    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-console-config\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.393538 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.393239    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-service-ca\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.394974 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.394952    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6385f70c-ceb6-4688-90ef-179c7678017c-console-oauth-config\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.395072 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.394984    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6385f70c-ceb6-4688-90ef-179c7678017c-console-serving-cert\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.403454 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.403433    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdzbz\" (UniqueName: \"kubernetes.io/projected/6385f70c-ceb6-4688-90ef-179c7678017c-kube-api-access-jdzbz\") pod \"console-784f899497-rpg4x\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") " pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.416806 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.416768    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-799d47dff5-c7hmg" podStartSLOduration=1.62071269 podStartE2EDuration="3.416752862s" totalImagesPullingTime="1.796040172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:23:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:23:18.415493476 +0000 UTC m=+90.193912888" watchObservedRunningTime="2026-09-06 10:23:18.416752862 +0000 UTC m=+90.195172281"
Sep 06 10:23:18.452460 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.452436    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:18.521269 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.521215    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:18.556802 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.556771    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:18.652456 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.652421    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:18.753957 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.753920    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:18.791373 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.791289    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-784f899497-rpg4x"]
Sep 06 10:23:18.794852 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:23:18.794827    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6385f70c_ceb6_4688_90ef_179c7678017c.slice/crio-b5f6c866b1f7baf3134f9f1dac859072569a4c5f6aa88f337811536d9b7ff195 WatchSource:0}: Error finding container b5f6c866b1f7baf3134f9f1dac859072569a4c5f6aa88f337811536d9b7ff195: Status 404 returned error can't find the container with id b5f6c866b1f7baf3134f9f1dac859072569a4c5f6aa88f337811536d9b7ff195
Sep 06 10:23:18.852618 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:18.852570    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:19.336223 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:19.336190    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:19.336657 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:19.336245    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:19.340827 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:19.340808    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:19.388729 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:19.388692    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784f899497-rpg4x" event={"ID":"6385f70c-ceb6-4688-90ef-179c7678017c","Type":"ContainerStarted","Data":"ada0a557181f3b3d009f0c063e19904e046a11b7546cfc8c47fba0bf2ec8e9e1"}
Sep 06 10:23:19.388849 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:19.388737    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784f899497-rpg4x" event={"ID":"6385f70c-ceb6-4688-90ef-179c7678017c","Type":"ContainerStarted","Data":"b5f6c866b1f7baf3134f9f1dac859072569a4c5f6aa88f337811536d9b7ff195"}
Sep 06 10:23:19.392551 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:19.392509    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:23:19.406872 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:19.406831    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-784f899497-rpg4x" podStartSLOduration=1.406818606 podStartE2EDuration="1.406818606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:23:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:23:19.405730259 +0000 UTC m=+91.184149671" watchObservedRunningTime="2026-09-06 10:23:19.406818606 +0000 UTC m=+91.185238018"
Sep 06 10:23:22.742762 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:22.742729    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:22.844085 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:22.844012    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:24.615655 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.615617    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-784f899497-rpg4x"]
Sep 06 10:23:24.644553 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.644520    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85445594b7-qsssn"]
Sep 06 10:23:24.650435 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.650419    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.659603 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.659579    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85445594b7-qsssn"]
Sep 06 10:23:24.745472 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.745439    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-oauth-serving-cert\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.745626 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.745497    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd8k4\" (UniqueName: \"kubernetes.io/projected/b5390554-5f42-4be1-bc2d-8aac5accaec8-kube-api-access-kd8k4\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.745626 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.745551    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5390554-5f42-4be1-bc2d-8aac5accaec8-console-oauth-config\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.745626 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.745577    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-service-ca\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.745763 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.745657    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-trusted-ca-bundle\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.745763 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.745693    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5390554-5f42-4be1-bc2d-8aac5accaec8-console-serving-cert\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.745763 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.745709    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-console-config\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.846445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.846416    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-trusted-ca-bundle\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.846572 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.846449    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5390554-5f42-4be1-bc2d-8aac5accaec8-console-serving-cert\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.846572 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.846468    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-console-config\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.846572 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.846517    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-oauth-serving-cert\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.846718 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.846579    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd8k4\" (UniqueName: \"kubernetes.io/projected/b5390554-5f42-4be1-bc2d-8aac5accaec8-kube-api-access-kd8k4\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.846718 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.846625    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5390554-5f42-4be1-bc2d-8aac5accaec8-console-oauth-config\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.846718 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.846642    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-service-ca\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.847265 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.847239    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-oauth-serving-cert\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.847390 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.847314    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-console-config\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.847493 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.847477    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-trusted-ca-bundle\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.847542 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.847507    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-service-ca\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.849023 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.849005    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5390554-5f42-4be1-bc2d-8aac5accaec8-console-serving-cert\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.849128 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.849077    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5390554-5f42-4be1-bc2d-8aac5accaec8-console-oauth-config\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.854603 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.854584    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd8k4\" (UniqueName: \"kubernetes.io/projected/b5390554-5f42-4be1-bc2d-8aac5accaec8-kube-api-access-kd8k4\") pod \"console-85445594b7-qsssn\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") " pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:24.959619 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:24.959590    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:25.232108 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:25.232058    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85445594b7-qsssn"]
Sep 06 10:23:25.234346 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:23:25.234299    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5390554_5f42_4be1_bc2d_8aac5accaec8.slice/crio-7bc434f6338abf91b80358130c4b0d6e8cbc06d39a4b0e6083277c63eec0c21c WatchSource:0}: Error finding container 7bc434f6338abf91b80358130c4b0d6e8cbc06d39a4b0e6083277c63eec0c21c: Status 404 returned error can't find the container with id 7bc434f6338abf91b80358130c4b0d6e8cbc06d39a4b0e6083277c63eec0c21c
Sep 06 10:23:25.257263 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:25.257241    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gdhpd"
Sep 06 10:23:25.414518 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:25.414475    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85445594b7-qsssn" event={"ID":"b5390554-5f42-4be1-bc2d-8aac5accaec8","Type":"ContainerStarted","Data":"8c4184776856c62384d0576757854c8db5793fb5b3a8d3f63a5835bd0de854cb"}
Sep 06 10:23:25.414518 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:25.414520    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85445594b7-qsssn" event={"ID":"b5390554-5f42-4be1-bc2d-8aac5accaec8","Type":"ContainerStarted","Data":"7bc434f6338abf91b80358130c4b0d6e8cbc06d39a4b0e6083277c63eec0c21c"}
Sep 06 10:23:25.431304 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:25.431255    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85445594b7-qsssn" podStartSLOduration=1.431241083 podStartE2EDuration="1.431241083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:23:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:23:25.430728056 +0000 UTC m=+97.209147470" watchObservedRunningTime="2026-09-06 10:23:25.431241083 +0000 UTC m=+97.209660496"
Sep 06 10:23:25.618254 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:25.618174    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:25.678233 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:25.678190    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:26.149694 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:26.149661    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:26.254773 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:26.254730    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:27.817529 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:27.817495    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:27.918746 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:27.918714    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:28.521539 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:28.521510    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:29.657650 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:29.657619    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:29.757270 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:29.757244    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:31.294162 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:31.294132    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:31.402754 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:31.402729    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:31.825408 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:31.825375    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:31.893568 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:31.893536    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:34.960743 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:34.960708    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:34.961140 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:34.960766    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:34.965571 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:34.965547    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:35.463380 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:35.463104    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:23:35.507128 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:35.507095    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f7c4fc77-65rbl"]
Sep 06 10:23:35.614609 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:35.614559    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:35.674634 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:35.674588    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:43.392579 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.392517    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6f899d8c59-htkf6" podUID="d5bcfaad-879c-4173-816a-63ddf0252bec" containerName="registry" containerID="cri-o://46ba08c13234910ab7e31faf18e20ac29185c493284fb58aacea85de14dc01b9" gracePeriod=30
Sep 06 10:23:43.644186 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.644132    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:23:43.692462 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.692433    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5bcfaad-879c-4173-816a-63ddf0252bec-installation-pull-secrets\") pod \"d5bcfaad-879c-4173-816a-63ddf0252bec\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") "
Sep 06 10:23:43.692618 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.692486    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls\") pod \"d5bcfaad-879c-4173-816a-63ddf0252bec\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") "
Sep 06 10:23:43.692618 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.692514    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-certificates\") pod \"d5bcfaad-879c-4173-816a-63ddf0252bec\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") "
Sep 06 10:23:43.692618 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.692549    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5bcfaad-879c-4173-816a-63ddf0252bec-trusted-ca\") pod \"d5bcfaad-879c-4173-816a-63ddf0252bec\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") "
Sep 06 10:23:43.692618 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.692590    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5bcfaad-879c-4173-816a-63ddf0252bec-image-registry-private-configuration\") pod \"d5bcfaad-879c-4173-816a-63ddf0252bec\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") "
Sep 06 10:23:43.692831 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.692634    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zz6vm\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-kube-api-access-zz6vm\") pod \"d5bcfaad-879c-4173-816a-63ddf0252bec\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") "
Sep 06 10:23:43.692831 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.692667    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5bcfaad-879c-4173-816a-63ddf0252bec-ca-trust-extracted\") pod \"d5bcfaad-879c-4173-816a-63ddf0252bec\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") "
Sep 06 10:23:43.692831 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.692713    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-bound-sa-token\") pod \"d5bcfaad-879c-4173-816a-63ddf0252bec\" (UID: \"d5bcfaad-879c-4173-816a-63ddf0252bec\") "
Sep 06 10:23:43.693365 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.693334    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5bcfaad-879c-4173-816a-63ddf0252bec-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d5bcfaad-879c-4173-816a-63ddf0252bec" (UID: "d5bcfaad-879c-4173-816a-63ddf0252bec"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:23:43.693658 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.693618    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d5bcfaad-879c-4173-816a-63ddf0252bec" (UID: "d5bcfaad-879c-4173-816a-63ddf0252bec"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:23:43.695221 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.695102    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5bcfaad-879c-4173-816a-63ddf0252bec-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d5bcfaad-879c-4173-816a-63ddf0252bec" (UID: "d5bcfaad-879c-4173-816a-63ddf0252bec"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 10:23:43.695377 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.695289    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5bcfaad-879c-4173-816a-63ddf0252bec-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d5bcfaad-879c-4173-816a-63ddf0252bec" (UID: "d5bcfaad-879c-4173-816a-63ddf0252bec"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 10:23:43.695572 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.695541    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d5bcfaad-879c-4173-816a-63ddf0252bec" (UID: "d5bcfaad-879c-4173-816a-63ddf0252bec"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:23:43.695681 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.695598    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-kube-api-access-zz6vm" (OuterVolumeSpecName: "kube-api-access-zz6vm") pod "d5bcfaad-879c-4173-816a-63ddf0252bec" (UID: "d5bcfaad-879c-4173-816a-63ddf0252bec"). InnerVolumeSpecName "kube-api-access-zz6vm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:23:43.695681 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.695663    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d5bcfaad-879c-4173-816a-63ddf0252bec" (UID: "d5bcfaad-879c-4173-816a-63ddf0252bec"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:23:43.702631 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.702607    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5bcfaad-879c-4173-816a-63ddf0252bec-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d5bcfaad-879c-4173-816a-63ddf0252bec" (UID: "d5bcfaad-879c-4173-816a-63ddf0252bec"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:23:43.794250 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.794218    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zz6vm\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-kube-api-access-zz6vm\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:23:43.794250 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.794251    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5bcfaad-879c-4173-816a-63ddf0252bec-ca-trust-extracted\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:23:43.794485 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.794265    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-bound-sa-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:23:43.794485 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.794284    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5bcfaad-879c-4173-816a-63ddf0252bec-installation-pull-secrets\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:23:43.794485 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.794296    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-tls\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:23:43.794485 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.794309    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5bcfaad-879c-4173-816a-63ddf0252bec-registry-certificates\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:23:43.794485 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.794335    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5bcfaad-879c-4173-816a-63ddf0252bec-trusted-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:23:43.794485 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:43.794349    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5bcfaad-879c-4173-816a-63ddf0252bec-image-registry-private-configuration\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:23:44.496377 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:44.496334    2561 generic.go:356] "Generic (PLEG): container finished" podID="d5bcfaad-879c-4173-816a-63ddf0252bec" containerID="46ba08c13234910ab7e31faf18e20ac29185c493284fb58aacea85de14dc01b9" exitCode=0
Sep 06 10:23:44.496838 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:44.496395    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f899d8c59-htkf6"
Sep 06 10:23:44.496838 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:44.496419    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f899d8c59-htkf6" event={"ID":"d5bcfaad-879c-4173-816a-63ddf0252bec","Type":"ContainerDied","Data":"46ba08c13234910ab7e31faf18e20ac29185c493284fb58aacea85de14dc01b9"}
Sep 06 10:23:44.496838 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:44.496516    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f899d8c59-htkf6" event={"ID":"d5bcfaad-879c-4173-816a-63ddf0252bec","Type":"ContainerDied","Data":"29c1af293e188a487fba5afb3b6992823d31931b223f8522551153dd5aeff822"}
Sep 06 10:23:44.496838 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:44.496549    2561 scope.go:117] "RemoveContainer" containerID="46ba08c13234910ab7e31faf18e20ac29185c493284fb58aacea85de14dc01b9"
Sep 06 10:23:44.505604 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:44.505589    2561 scope.go:117] "RemoveContainer" containerID="46ba08c13234910ab7e31faf18e20ac29185c493284fb58aacea85de14dc01b9"
Sep 06 10:23:44.505853 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:23:44.505833    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46ba08c13234910ab7e31faf18e20ac29185c493284fb58aacea85de14dc01b9\": container with ID starting with 46ba08c13234910ab7e31faf18e20ac29185c493284fb58aacea85de14dc01b9 not found: ID does not exist" containerID="46ba08c13234910ab7e31faf18e20ac29185c493284fb58aacea85de14dc01b9"
Sep 06 10:23:44.505900 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:44.505862    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46ba08c13234910ab7e31faf18e20ac29185c493284fb58aacea85de14dc01b9"} err="failed to get container status \"46ba08c13234910ab7e31faf18e20ac29185c493284fb58aacea85de14dc01b9\": rpc error: code = NotFound desc = could not find container \"46ba08c13234910ab7e31faf18e20ac29185c493284fb58aacea85de14dc01b9\": container with ID starting with 46ba08c13234910ab7e31faf18e20ac29185c493284fb58aacea85de14dc01b9 not found: ID does not exist"
Sep 06 10:23:44.517258 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:44.517236    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6f899d8c59-htkf6"]
Sep 06 10:23:44.520516 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:44.520496    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6f899d8c59-htkf6"]
Sep 06 10:23:44.753627 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:44.753557    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5bcfaad-879c-4173-816a-63ddf0252bec" path="/var/lib/kubelet/pods/d5bcfaad-879c-4173-816a-63ddf0252bec/volumes"
Sep 06 10:23:46.300369 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:46.300316    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:46.365665 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:46.365635    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:49.635795 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:49.635751    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-784f899497-rpg4x" podUID="6385f70c-ceb6-4688-90ef-179c7678017c" containerName="console" containerID="cri-o://ada0a557181f3b3d009f0c063e19904e046a11b7546cfc8c47fba0bf2ec8e9e1" gracePeriod=15
Sep 06 10:23:49.880216 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:49.880193    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:49.943039 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:49.943012    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6385f70c-ceb6-4688-90ef-179c7678017c-console-oauth-config\") pod \"6385f70c-ceb6-4688-90ef-179c7678017c\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") "
Sep 06 10:23:49.943199 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:49.943060    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-oauth-serving-cert\") pod \"6385f70c-ceb6-4688-90ef-179c7678017c\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") "
Sep 06 10:23:49.943199 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:49.943088    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-service-ca\") pod \"6385f70c-ceb6-4688-90ef-179c7678017c\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") "
Sep 06 10:23:49.943199 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:49.943112    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6385f70c-ceb6-4688-90ef-179c7678017c-console-serving-cert\") pod \"6385f70c-ceb6-4688-90ef-179c7678017c\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") "
Sep 06 10:23:49.943388 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:49.943366    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-console-config\") pod \"6385f70c-ceb6-4688-90ef-179c7678017c\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") "
Sep 06 10:23:49.943469 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:49.943417    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-trusted-ca-bundle\") pod \"6385f70c-ceb6-4688-90ef-179c7678017c\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") "
Sep 06 10:23:49.943469 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:49.943453    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6385f70c-ceb6-4688-90ef-179c7678017c" (UID: "6385f70c-ceb6-4688-90ef-179c7678017c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:23:49.943572 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:49.943450    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-service-ca" (OuterVolumeSpecName: "service-ca") pod "6385f70c-ceb6-4688-90ef-179c7678017c" (UID: "6385f70c-ceb6-4688-90ef-179c7678017c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:23:49.943572 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:49.943471    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdzbz\" (UniqueName: \"kubernetes.io/projected/6385f70c-ceb6-4688-90ef-179c7678017c-kube-api-access-jdzbz\") pod \"6385f70c-ceb6-4688-90ef-179c7678017c\" (UID: \"6385f70c-ceb6-4688-90ef-179c7678017c\") "
Sep 06 10:23:49.943791 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:49.943750    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-console-config" (OuterVolumeSpecName: "console-config") pod "6385f70c-ceb6-4688-90ef-179c7678017c" (UID: "6385f70c-ceb6-4688-90ef-179c7678017c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:23:49.943871 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:49.943847    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6385f70c-ceb6-4688-90ef-179c7678017c" (UID: "6385f70c-ceb6-4688-90ef-179c7678017c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:23:49.943927 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:49.943879    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:23:49.943927 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:49.943900    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-console-config\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:23:49.943927 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:49.943915    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-oauth-serving-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:23:49.945396 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:49.945377    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6385f70c-ceb6-4688-90ef-179c7678017c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6385f70c-ceb6-4688-90ef-179c7678017c" (UID: "6385f70c-ceb6-4688-90ef-179c7678017c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 10:23:49.945647 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:49.945625    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6385f70c-ceb6-4688-90ef-179c7678017c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6385f70c-ceb6-4688-90ef-179c7678017c" (UID: "6385f70c-ceb6-4688-90ef-179c7678017c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 10:23:49.945690 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:49.945656    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6385f70c-ceb6-4688-90ef-179c7678017c-kube-api-access-jdzbz" (OuterVolumeSpecName: "kube-api-access-jdzbz") pod "6385f70c-ceb6-4688-90ef-179c7678017c" (UID: "6385f70c-ceb6-4688-90ef-179c7678017c"). InnerVolumeSpecName "kube-api-access-jdzbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:23:50.044945 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:50.044919    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6385f70c-ceb6-4688-90ef-179c7678017c-console-serving-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:23:50.044945 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:50.044941    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6385f70c-ceb6-4688-90ef-179c7678017c-trusted-ca-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:23:50.045075 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:50.044950    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdzbz\" (UniqueName: \"kubernetes.io/projected/6385f70c-ceb6-4688-90ef-179c7678017c-kube-api-access-jdzbz\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:23:50.045075 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:50.044960    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6385f70c-ceb6-4688-90ef-179c7678017c-console-oauth-config\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:23:50.522106 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:50.522073    2561 generic.go:356] "Generic (PLEG): container finished" podID="6385f70c-ceb6-4688-90ef-179c7678017c" containerID="ada0a557181f3b3d009f0c063e19904e046a11b7546cfc8c47fba0bf2ec8e9e1" exitCode=0
Sep 06 10:23:50.522281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:50.522117    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-784f899497-rpg4x"
Sep 06 10:23:50.522281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:50.522121    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784f899497-rpg4x" event={"ID":"6385f70c-ceb6-4688-90ef-179c7678017c","Type":"ContainerDied","Data":"ada0a557181f3b3d009f0c063e19904e046a11b7546cfc8c47fba0bf2ec8e9e1"}
Sep 06 10:23:50.522281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:50.522254    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-784f899497-rpg4x" event={"ID":"6385f70c-ceb6-4688-90ef-179c7678017c","Type":"ContainerDied","Data":"b5f6c866b1f7baf3134f9f1dac859072569a4c5f6aa88f337811536d9b7ff195"}
Sep 06 10:23:50.522397 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:50.522289    2561 scope.go:117] "RemoveContainer" containerID="ada0a557181f3b3d009f0c063e19904e046a11b7546cfc8c47fba0bf2ec8e9e1"
Sep 06 10:23:50.533831 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:50.533814    2561 scope.go:117] "RemoveContainer" containerID="ada0a557181f3b3d009f0c063e19904e046a11b7546cfc8c47fba0bf2ec8e9e1"
Sep 06 10:23:50.534103 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:23:50.534080    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ada0a557181f3b3d009f0c063e19904e046a11b7546cfc8c47fba0bf2ec8e9e1\": container with ID starting with ada0a557181f3b3d009f0c063e19904e046a11b7546cfc8c47fba0bf2ec8e9e1 not found: ID does not exist" containerID="ada0a557181f3b3d009f0c063e19904e046a11b7546cfc8c47fba0bf2ec8e9e1"
Sep 06 10:23:50.534216 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:50.534108    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ada0a557181f3b3d009f0c063e19904e046a11b7546cfc8c47fba0bf2ec8e9e1"} err="failed to get container status \"ada0a557181f3b3d009f0c063e19904e046a11b7546cfc8c47fba0bf2ec8e9e1\": rpc error: code = NotFound desc = could not find container \"ada0a557181f3b3d009f0c063e19904e046a11b7546cfc8c47fba0bf2ec8e9e1\": container with ID starting with ada0a557181f3b3d009f0c063e19904e046a11b7546cfc8c47fba0bf2ec8e9e1 not found: ID does not exist"
Sep 06 10:23:50.543676 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:50.543646    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-784f899497-rpg4x"]
Sep 06 10:23:50.549437 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:50.549416    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-784f899497-rpg4x"]
Sep 06 10:23:50.753364 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:50.753315    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6385f70c-ceb6-4688-90ef-179c7678017c" path="/var/lib/kubelet/pods/6385f70c-ceb6-4688-90ef-179c7678017c/volumes"
Sep 06 10:23:53.535773 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:53.535740    2561 generic.go:356] "Generic (PLEG): container finished" podID="e20c6a2b-e419-4124-884a-b60dac26955d" containerID="6db20a779d24b17bbd283ddbd142d44149ce5ccb5dc75e6d8fb326a9e706de5c" exitCode=0
Sep 06 10:23:53.536251 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:53.535816    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fcskx" event={"ID":"e20c6a2b-e419-4124-884a-b60dac26955d","Type":"ContainerDied","Data":"6db20a779d24b17bbd283ddbd142d44149ce5ccb5dc75e6d8fb326a9e706de5c"}
Sep 06 10:23:53.540982 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:53.536593    2561 scope.go:117] "RemoveContainer" containerID="6db20a779d24b17bbd283ddbd142d44149ce5ccb5dc75e6d8fb326a9e706de5c"
Sep 06 10:23:53.542796 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:53.542768    2561 generic.go:356] "Generic (PLEG): container finished" podID="8a2b85b1-450b-453c-a0a4-057de1690742" containerID="799707b0cee1520ba8e919ccb6eeea623b6a555bd3e5fd4c72d06fd29aca56af" exitCode=0
Sep 06 10:23:53.542902 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:53.542838    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p77fj" event={"ID":"8a2b85b1-450b-453c-a0a4-057de1690742","Type":"ContainerDied","Data":"799707b0cee1520ba8e919ccb6eeea623b6a555bd3e5fd4c72d06fd29aca56af"}
Sep 06 10:23:53.543144 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:53.543130    2561 scope.go:117] "RemoveContainer" containerID="799707b0cee1520ba8e919ccb6eeea623b6a555bd3e5fd4c72d06fd29aca56af"
Sep 06 10:23:53.613380 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:53.613353    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:53.714547 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:53.714517    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:53.770164 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:53.770127    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:54.088862 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:54.088817    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:23:54.548630 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:54.548597    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-fcskx" event={"ID":"e20c6a2b-e419-4124-884a-b60dac26955d","Type":"ContainerStarted","Data":"bc285dae9f254f58dd31e25e67d8876171aa88e75822ae6091f3ab99a534eb32"}
Sep 06 10:23:54.550462 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:23:54.550437    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-p77fj" event={"ID":"8a2b85b1-450b-453c-a0a4-057de1690742","Type":"ContainerStarted","Data":"166335bbb64924a87d3dfdcc7fa851881d122c04efb5fc3aa4bb94cec109a835"}
Sep 06 10:24:00.527241 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:00.527180    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59f7c4fc77-65rbl" podUID="c635862e-8355-4312-ba8b-2fcba2bd6649" containerName="console" containerID="cri-o://b80a70ecc746bb4295e38250927317487f0c17240e8b7cebc996ca45c934014f" gracePeriod=15
Sep 06 10:24:00.777349 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:00.777276    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:24:00.832229 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:00.832199    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c635862e-8355-4312-ba8b-2fcba2bd6649-console-config\") pod \"c635862e-8355-4312-ba8b-2fcba2bd6649\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") "
Sep 06 10:24:00.832229 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:00.832232    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c635862e-8355-4312-ba8b-2fcba2bd6649-console-serving-cert\") pod \"c635862e-8355-4312-ba8b-2fcba2bd6649\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") "
Sep 06 10:24:00.832473 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:00.832261    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c635862e-8355-4312-ba8b-2fcba2bd6649-service-ca\") pod \"c635862e-8355-4312-ba8b-2fcba2bd6649\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") "
Sep 06 10:24:00.832473 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:00.832287    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c635862e-8355-4312-ba8b-2fcba2bd6649-oauth-serving-cert\") pod \"c635862e-8355-4312-ba8b-2fcba2bd6649\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") "
Sep 06 10:24:00.832473 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:00.832425    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlgqs\" (UniqueName: \"kubernetes.io/projected/c635862e-8355-4312-ba8b-2fcba2bd6649-kube-api-access-xlgqs\") pod \"c635862e-8355-4312-ba8b-2fcba2bd6649\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") "
Sep 06 10:24:00.832612 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:00.832475    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c635862e-8355-4312-ba8b-2fcba2bd6649-console-oauth-config\") pod \"c635862e-8355-4312-ba8b-2fcba2bd6649\" (UID: \"c635862e-8355-4312-ba8b-2fcba2bd6649\") "
Sep 06 10:24:00.832712 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:00.832683    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c635862e-8355-4312-ba8b-2fcba2bd6649-console-config" (OuterVolumeSpecName: "console-config") pod "c635862e-8355-4312-ba8b-2fcba2bd6649" (UID: "c635862e-8355-4312-ba8b-2fcba2bd6649"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:24:00.832712 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:00.832698    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c635862e-8355-4312-ba8b-2fcba2bd6649-service-ca" (OuterVolumeSpecName: "service-ca") pod "c635862e-8355-4312-ba8b-2fcba2bd6649" (UID: "c635862e-8355-4312-ba8b-2fcba2bd6649"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:24:00.832830 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:00.832693    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c635862e-8355-4312-ba8b-2fcba2bd6649-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c635862e-8355-4312-ba8b-2fcba2bd6649" (UID: "c635862e-8355-4312-ba8b-2fcba2bd6649"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:24:00.834585 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:00.834552    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c635862e-8355-4312-ba8b-2fcba2bd6649-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c635862e-8355-4312-ba8b-2fcba2bd6649" (UID: "c635862e-8355-4312-ba8b-2fcba2bd6649"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 10:24:00.834696 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:00.834586    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c635862e-8355-4312-ba8b-2fcba2bd6649-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c635862e-8355-4312-ba8b-2fcba2bd6649" (UID: "c635862e-8355-4312-ba8b-2fcba2bd6649"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 10:24:00.834696 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:00.834619    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c635862e-8355-4312-ba8b-2fcba2bd6649-kube-api-access-xlgqs" (OuterVolumeSpecName: "kube-api-access-xlgqs") pod "c635862e-8355-4312-ba8b-2fcba2bd6649" (UID: "c635862e-8355-4312-ba8b-2fcba2bd6649"). InnerVolumeSpecName "kube-api-access-xlgqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:24:00.933145 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:00.933095    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c635862e-8355-4312-ba8b-2fcba2bd6649-console-config\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:24:00.933145 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:00.933137    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c635862e-8355-4312-ba8b-2fcba2bd6649-console-serving-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:24:00.933145 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:00.933147    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c635862e-8355-4312-ba8b-2fcba2bd6649-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:24:00.933145 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:00.933156    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c635862e-8355-4312-ba8b-2fcba2bd6649-oauth-serving-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:24:00.933145 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:00.933164    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlgqs\" (UniqueName: \"kubernetes.io/projected/c635862e-8355-4312-ba8b-2fcba2bd6649-kube-api-access-xlgqs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:24:00.933459 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:00.933174    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c635862e-8355-4312-ba8b-2fcba2bd6649-console-oauth-config\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:24:01.578037 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:01.578001    2561 generic.go:356] "Generic (PLEG): container finished" podID="c635862e-8355-4312-ba8b-2fcba2bd6649" containerID="b80a70ecc746bb4295e38250927317487f0c17240e8b7cebc996ca45c934014f" exitCode=0
Sep 06 10:24:01.578418 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:01.578045    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59f7c4fc77-65rbl"
Sep 06 10:24:01.578418 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:01.578085    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f7c4fc77-65rbl" event={"ID":"c635862e-8355-4312-ba8b-2fcba2bd6649","Type":"ContainerDied","Data":"b80a70ecc746bb4295e38250927317487f0c17240e8b7cebc996ca45c934014f"}
Sep 06 10:24:01.578418 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:01.578139    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59f7c4fc77-65rbl" event={"ID":"c635862e-8355-4312-ba8b-2fcba2bd6649","Type":"ContainerDied","Data":"7ac8b7a4ad88a8d9467914191835be17f3cb675acef3a8c542ce3885984a7865"}
Sep 06 10:24:01.578418 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:01.578164    2561 scope.go:117] "RemoveContainer" containerID="b80a70ecc746bb4295e38250927317487f0c17240e8b7cebc996ca45c934014f"
Sep 06 10:24:01.589100 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:01.589083    2561 scope.go:117] "RemoveContainer" containerID="b80a70ecc746bb4295e38250927317487f0c17240e8b7cebc996ca45c934014f"
Sep 06 10:24:01.589425 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:24:01.589406    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b80a70ecc746bb4295e38250927317487f0c17240e8b7cebc996ca45c934014f\": container with ID starting with b80a70ecc746bb4295e38250927317487f0c17240e8b7cebc996ca45c934014f not found: ID does not exist" containerID="b80a70ecc746bb4295e38250927317487f0c17240e8b7cebc996ca45c934014f"
Sep 06 10:24:01.589498 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:01.589434    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b80a70ecc746bb4295e38250927317487f0c17240e8b7cebc996ca45c934014f"} err="failed to get container status \"b80a70ecc746bb4295e38250927317487f0c17240e8b7cebc996ca45c934014f\": rpc error: code = NotFound desc = could not find container \"b80a70ecc746bb4295e38250927317487f0c17240e8b7cebc996ca45c934014f\": container with ID starting with b80a70ecc746bb4295e38250927317487f0c17240e8b7cebc996ca45c934014f not found: ID does not exist"
Sep 06 10:24:01.598116 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:01.598096    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59f7c4fc77-65rbl"]
Sep 06 10:24:01.602910 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:01.602889    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59f7c4fc77-65rbl"]
Sep 06 10:24:02.757259 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:02.757226    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c635862e-8355-4312-ba8b-2fcba2bd6649" path="/var/lib/kubelet/pods/c635862e-8355-4312-ba8b-2fcba2bd6649/volumes"
Sep 06 10:24:03.589223 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:03.589140    2561 generic.go:356] "Generic (PLEG): container finished" podID="c3c63327-812e-4353-903f-2ad8d3a5b31f" containerID="e218b8204823358765b1f546d6d874e7963fb0b3fe6a8ec3533a9d6ec8e07d7f" exitCode=0
Sep 06 10:24:03.589223 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:03.589213    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt" event={"ID":"c3c63327-812e-4353-903f-2ad8d3a5b31f","Type":"ContainerDied","Data":"e218b8204823358765b1f546d6d874e7963fb0b3fe6a8ec3533a9d6ec8e07d7f"}
Sep 06 10:24:03.589569 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:03.589556    2561 scope.go:117] "RemoveContainer" containerID="e218b8204823358765b1f546d6d874e7963fb0b3fe6a8ec3533a9d6ec8e07d7f"
Sep 06 10:24:04.595034 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:04.595004    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-cs9gt" event={"ID":"c3c63327-812e-4353-903f-2ad8d3a5b31f","Type":"ContainerStarted","Data":"ef0992d34560fc8fa032fbf9fcea2941144ff88a280fac700d82e04e63ca56cd"}
Sep 06 10:24:07.794935 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:07.794893    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:24:15.147754 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:15.147720    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:24:26.380687 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:26.380646    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:24:26.480593 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:26.480560    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:24:30.645954 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:30.645920    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 10:24:30.646389 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:30.646251    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="alertmanager" containerID="cri-o://13d4dc64b8056ab8132b4746e60767213fe9acb47bc9c8712ccfaa07d8bbd127" gracePeriod=120
Sep 06 10:24:30.646389 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:30.646261    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="kube-rbac-proxy" containerID="cri-o://7310581d36d44487921abf928c9501faf79ea755b4664993aa23650bfe996e7c" gracePeriod=120
Sep 06 10:24:30.646389 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:30.646304    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="kube-rbac-proxy-web" containerID="cri-o://578b5c0694164038524faa0fa347709dc459fd929a3ae0f5839fcb72934de81d" gracePeriod=120
Sep 06 10:24:30.646389 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:30.646316    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="config-reloader" containerID="cri-o://201637c4fee9b562554b0b6a2e726a585d0610fd4634ade4a40f8b1dfcd4d319" gracePeriod=120
Sep 06 10:24:30.646607 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:30.646263    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="prom-label-proxy" containerID="cri-o://246385f9e5438f59f1ef0610714854cd64cc3f60b3b99b4b5213b7c93a925109" gracePeriod=120
Sep 06 10:24:30.646607 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:30.646281    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="kube-rbac-proxy-metric" containerID="cri-o://c6f50cbd7f13fb680330f9902d2225e5f00aa956d94faf20472b6dc746f8ed42" gracePeriod=120
Sep 06 10:24:31.707638 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.707606    2561 generic.go:356] "Generic (PLEG): container finished" podID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerID="246385f9e5438f59f1ef0610714854cd64cc3f60b3b99b4b5213b7c93a925109" exitCode=0
Sep 06 10:24:31.707638 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.707631    2561 generic.go:356] "Generic (PLEG): container finished" podID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerID="7310581d36d44487921abf928c9501faf79ea755b4664993aa23650bfe996e7c" exitCode=0
Sep 06 10:24:31.707638 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.707640    2561 generic.go:356] "Generic (PLEG): container finished" podID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerID="201637c4fee9b562554b0b6a2e726a585d0610fd4634ade4a40f8b1dfcd4d319" exitCode=0
Sep 06 10:24:31.708035 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.707650    2561 generic.go:356] "Generic (PLEG): container finished" podID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerID="13d4dc64b8056ab8132b4746e60767213fe9acb47bc9c8712ccfaa07d8bbd127" exitCode=0
Sep 06 10:24:31.708035 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.707673    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a55c8e5-db73-4bd8-85b9-5965720f51ac","Type":"ContainerDied","Data":"246385f9e5438f59f1ef0610714854cd64cc3f60b3b99b4b5213b7c93a925109"}
Sep 06 10:24:31.708035 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.707736    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a55c8e5-db73-4bd8-85b9-5965720f51ac","Type":"ContainerDied","Data":"7310581d36d44487921abf928c9501faf79ea755b4664993aa23650bfe996e7c"}
Sep 06 10:24:31.708035 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.707762    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a55c8e5-db73-4bd8-85b9-5965720f51ac","Type":"ContainerDied","Data":"201637c4fee9b562554b0b6a2e726a585d0610fd4634ade4a40f8b1dfcd4d319"}
Sep 06 10:24:31.708035 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.707793    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a55c8e5-db73-4bd8-85b9-5965720f51ac","Type":"ContainerDied","Data":"13d4dc64b8056ab8132b4746e60767213fe9acb47bc9c8712ccfaa07d8bbd127"}
Sep 06 10:24:31.890718 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.890690    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:31.988338 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.988234    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a55c8e5-db73-4bd8-85b9-5965720f51ac-metrics-client-ca\") pod \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") "
Sep 06 10:24:31.988338 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.988276    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a55c8e5-db73-4bd8-85b9-5965720f51ac-tls-assets\") pod \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") "
Sep 06 10:24:31.988338 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.988293    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jff2h\" (UniqueName: \"kubernetes.io/projected/2a55c8e5-db73-4bd8-85b9-5965720f51ac-kube-api-access-jff2h\") pod \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") "
Sep 06 10:24:31.988338 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.988309    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-cluster-tls-config\") pod \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") "
Sep 06 10:24:31.988670 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.988456    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") "
Sep 06 10:24:31.988670 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.988512    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a55c8e5-db73-4bd8-85b9-5965720f51ac-alertmanager-trusted-ca-bundle\") pod \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") "
Sep 06 10:24:31.988670 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.988545    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-web-config\") pod \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") "
Sep 06 10:24:31.988829 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.988686    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-kube-rbac-proxy-web\") pod \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") "
Sep 06 10:24:31.988829 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.988726    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2a55c8e5-db73-4bd8-85b9-5965720f51ac-alertmanager-main-db\") pod \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") "
Sep 06 10:24:31.988829 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.988746    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a55c8e5-db73-4bd8-85b9-5965720f51ac-config-out\") pod \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") "
Sep 06 10:24:31.988829 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.988770    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-kube-rbac-proxy\") pod \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") "
Sep 06 10:24:31.988829 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.988807    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-main-tls\") pod \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") "
Sep 06 10:24:31.989086 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.988840    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-config-volume\") pod \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\" (UID: \"2a55c8e5-db73-4bd8-85b9-5965720f51ac\") "
Sep 06 10:24:31.989611 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.988680    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a55c8e5-db73-4bd8-85b9-5965720f51ac-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "2a55c8e5-db73-4bd8-85b9-5965720f51ac" (UID: "2a55c8e5-db73-4bd8-85b9-5965720f51ac"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:24:31.989611 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.989064    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a55c8e5-db73-4bd8-85b9-5965720f51ac-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "2a55c8e5-db73-4bd8-85b9-5965720f51ac" (UID: "2a55c8e5-db73-4bd8-85b9-5965720f51ac"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:24:31.989611 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.989506    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a55c8e5-db73-4bd8-85b9-5965720f51ac-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "2a55c8e5-db73-4bd8-85b9-5965720f51ac" (UID: "2a55c8e5-db73-4bd8-85b9-5965720f51ac"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:24:31.991487 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.991314    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "2a55c8e5-db73-4bd8-85b9-5965720f51ac" (UID: "2a55c8e5-db73-4bd8-85b9-5965720f51ac"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 10:24:31.991741 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.991719    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a55c8e5-db73-4bd8-85b9-5965720f51ac-kube-api-access-jff2h" (OuterVolumeSpecName: "kube-api-access-jff2h") pod "2a55c8e5-db73-4bd8-85b9-5965720f51ac" (UID: "2a55c8e5-db73-4bd8-85b9-5965720f51ac"). InnerVolumeSpecName "kube-api-access-jff2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:24:31.991920 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.991888    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "2a55c8e5-db73-4bd8-85b9-5965720f51ac" (UID: "2a55c8e5-db73-4bd8-85b9-5965720f51ac"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 10:24:31.992205 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.992181    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "2a55c8e5-db73-4bd8-85b9-5965720f51ac" (UID: "2a55c8e5-db73-4bd8-85b9-5965720f51ac"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 10:24:31.992292 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.992228    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a55c8e5-db73-4bd8-85b9-5965720f51ac-config-out" (OuterVolumeSpecName: "config-out") pod "2a55c8e5-db73-4bd8-85b9-5965720f51ac" (UID: "2a55c8e5-db73-4bd8-85b9-5965720f51ac"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:24:31.992428 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.992409    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "2a55c8e5-db73-4bd8-85b9-5965720f51ac" (UID: "2a55c8e5-db73-4bd8-85b9-5965720f51ac"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 10:24:31.992795 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.992765    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a55c8e5-db73-4bd8-85b9-5965720f51ac-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2a55c8e5-db73-4bd8-85b9-5965720f51ac" (UID: "2a55c8e5-db73-4bd8-85b9-5965720f51ac"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:24:31.992873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.992834    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-config-volume" (OuterVolumeSpecName: "config-volume") pod "2a55c8e5-db73-4bd8-85b9-5965720f51ac" (UID: "2a55c8e5-db73-4bd8-85b9-5965720f51ac"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 10:24:31.995989 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:31.995967    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "2a55c8e5-db73-4bd8-85b9-5965720f51ac" (UID: "2a55c8e5-db73-4bd8-85b9-5965720f51ac"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 10:24:32.002133 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.002112    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-web-config" (OuterVolumeSpecName: "web-config") pod "2a55c8e5-db73-4bd8-85b9-5965720f51ac" (UID: "2a55c8e5-db73-4bd8-85b9-5965720f51ac"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 10:24:32.089678 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.089650    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:24:32.089678 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.089673    2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a55c8e5-db73-4bd8-85b9-5965720f51ac-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:24:32.089825 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.089703    2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-web-config\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:24:32.089825 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.089712    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:24:32.089825 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.089721    2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2a55c8e5-db73-4bd8-85b9-5965720f51ac-alertmanager-main-db\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:24:32.089825 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.089732    2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a55c8e5-db73-4bd8-85b9-5965720f51ac-config-out\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:24:32.089825 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.089740    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:24:32.089825 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.089749    2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-secret-alertmanager-main-tls\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:24:32.089825 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.089758    2561 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-config-volume\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:24:32.089825 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.089767    2561 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a55c8e5-db73-4bd8-85b9-5965720f51ac-metrics-client-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:24:32.089825 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.089774    2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a55c8e5-db73-4bd8-85b9-5965720f51ac-tls-assets\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:24:32.089825 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.089782    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jff2h\" (UniqueName: \"kubernetes.io/projected/2a55c8e5-db73-4bd8-85b9-5965720f51ac-kube-api-access-jff2h\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:24:32.089825 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.089791    2561 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2a55c8e5-db73-4bd8-85b9-5965720f51ac-cluster-tls-config\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:24:32.714862 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.714831    2561 generic.go:356] "Generic (PLEG): container finished" podID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerID="c6f50cbd7f13fb680330f9902d2225e5f00aa956d94faf20472b6dc746f8ed42" exitCode=0
Sep 06 10:24:32.714862 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.714855    2561 generic.go:356] "Generic (PLEG): container finished" podID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerID="578b5c0694164038524faa0fa347709dc459fd929a3ae0f5839fcb72934de81d" exitCode=0
Sep 06 10:24:32.715371 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.714879    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a55c8e5-db73-4bd8-85b9-5965720f51ac","Type":"ContainerDied","Data":"c6f50cbd7f13fb680330f9902d2225e5f00aa956d94faf20472b6dc746f8ed42"}
Sep 06 10:24:32.715371 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.714916    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.715371 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.714950    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a55c8e5-db73-4bd8-85b9-5965720f51ac","Type":"ContainerDied","Data":"578b5c0694164038524faa0fa347709dc459fd929a3ae0f5839fcb72934de81d"}
Sep 06 10:24:32.715371 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.714980    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2a55c8e5-db73-4bd8-85b9-5965720f51ac","Type":"ContainerDied","Data":"9e4b4f1cac78df078c3d0c2198eaf36057b055c0af7e3b57d02869c84d569a6d"}
Sep 06 10:24:32.715371 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.715014    2561 scope.go:117] "RemoveContainer" containerID="246385f9e5438f59f1ef0610714854cd64cc3f60b3b99b4b5213b7c93a925109"
Sep 06 10:24:32.722490 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.722470    2561 scope.go:117] "RemoveContainer" containerID="c6f50cbd7f13fb680330f9902d2225e5f00aa956d94faf20472b6dc746f8ed42"
Sep 06 10:24:32.729246 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.729232    2561 scope.go:117] "RemoveContainer" containerID="7310581d36d44487921abf928c9501faf79ea755b4664993aa23650bfe996e7c"
Sep 06 10:24:32.735423 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.735400    2561 scope.go:117] "RemoveContainer" containerID="578b5c0694164038524faa0fa347709dc459fd929a3ae0f5839fcb72934de81d"
Sep 06 10:24:32.739122 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.739103    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 10:24:32.742812 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.742794    2561 scope.go:117] "RemoveContainer" containerID="201637c4fee9b562554b0b6a2e726a585d0610fd4634ade4a40f8b1dfcd4d319"
Sep 06 10:24:32.744276 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.744258    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 10:24:32.749518 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.749498    2561 scope.go:117] "RemoveContainer" containerID="13d4dc64b8056ab8132b4746e60767213fe9acb47bc9c8712ccfaa07d8bbd127"
Sep 06 10:24:32.753276 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.753250    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" path="/var/lib/kubelet/pods/2a55c8e5-db73-4bd8-85b9-5965720f51ac/volumes"
Sep 06 10:24:32.756629 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.756612    2561 scope.go:117] "RemoveContainer" containerID="cca8df210968811786f58c0a58fd2adf8d89083fe4cb8af18bc5a830c51b5e33"
Sep 06 10:24:32.763230 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.763083    2561 scope.go:117] "RemoveContainer" containerID="246385f9e5438f59f1ef0610714854cd64cc3f60b3b99b4b5213b7c93a925109"
Sep 06 10:24:32.763424 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:24:32.763393    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"246385f9e5438f59f1ef0610714854cd64cc3f60b3b99b4b5213b7c93a925109\": container with ID starting with 246385f9e5438f59f1ef0610714854cd64cc3f60b3b99b4b5213b7c93a925109 not found: ID does not exist" containerID="246385f9e5438f59f1ef0610714854cd64cc3f60b3b99b4b5213b7c93a925109"
Sep 06 10:24:32.763492 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.763432    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"246385f9e5438f59f1ef0610714854cd64cc3f60b3b99b4b5213b7c93a925109"} err="failed to get container status \"246385f9e5438f59f1ef0610714854cd64cc3f60b3b99b4b5213b7c93a925109\": rpc error: code = NotFound desc = could not find container \"246385f9e5438f59f1ef0610714854cd64cc3f60b3b99b4b5213b7c93a925109\": container with ID starting with 246385f9e5438f59f1ef0610714854cd64cc3f60b3b99b4b5213b7c93a925109 not found: ID does not exist"
Sep 06 10:24:32.763492 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.763451    2561 scope.go:117] "RemoveContainer" containerID="c6f50cbd7f13fb680330f9902d2225e5f00aa956d94faf20472b6dc746f8ed42"
Sep 06 10:24:32.763745 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:24:32.763721    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6f50cbd7f13fb680330f9902d2225e5f00aa956d94faf20472b6dc746f8ed42\": container with ID starting with c6f50cbd7f13fb680330f9902d2225e5f00aa956d94faf20472b6dc746f8ed42 not found: ID does not exist" containerID="c6f50cbd7f13fb680330f9902d2225e5f00aa956d94faf20472b6dc746f8ed42"
Sep 06 10:24:32.763879 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.763750    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6f50cbd7f13fb680330f9902d2225e5f00aa956d94faf20472b6dc746f8ed42"} err="failed to get container status \"c6f50cbd7f13fb680330f9902d2225e5f00aa956d94faf20472b6dc746f8ed42\": rpc error: code = NotFound desc = could not find container \"c6f50cbd7f13fb680330f9902d2225e5f00aa956d94faf20472b6dc746f8ed42\": container with ID starting with c6f50cbd7f13fb680330f9902d2225e5f00aa956d94faf20472b6dc746f8ed42 not found: ID does not exist"
Sep 06 10:24:32.763879 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.763770    2561 scope.go:117] "RemoveContainer" containerID="7310581d36d44487921abf928c9501faf79ea755b4664993aa23650bfe996e7c"
Sep 06 10:24:32.764095 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:24:32.764074    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7310581d36d44487921abf928c9501faf79ea755b4664993aa23650bfe996e7c\": container with ID starting with 7310581d36d44487921abf928c9501faf79ea755b4664993aa23650bfe996e7c not found: ID does not exist" containerID="7310581d36d44487921abf928c9501faf79ea755b4664993aa23650bfe996e7c"
Sep 06 10:24:32.764138 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.764100    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7310581d36d44487921abf928c9501faf79ea755b4664993aa23650bfe996e7c"} err="failed to get container status \"7310581d36d44487921abf928c9501faf79ea755b4664993aa23650bfe996e7c\": rpc error: code = NotFound desc = could not find container \"7310581d36d44487921abf928c9501faf79ea755b4664993aa23650bfe996e7c\": container with ID starting with 7310581d36d44487921abf928c9501faf79ea755b4664993aa23650bfe996e7c not found: ID does not exist"
Sep 06 10:24:32.764138 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.764123    2561 scope.go:117] "RemoveContainer" containerID="578b5c0694164038524faa0fa347709dc459fd929a3ae0f5839fcb72934de81d"
Sep 06 10:24:32.764384 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:24:32.764367    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"578b5c0694164038524faa0fa347709dc459fd929a3ae0f5839fcb72934de81d\": container with ID starting with 578b5c0694164038524faa0fa347709dc459fd929a3ae0f5839fcb72934de81d not found: ID does not exist" containerID="578b5c0694164038524faa0fa347709dc459fd929a3ae0f5839fcb72934de81d"
Sep 06 10:24:32.764434 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.764388    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"578b5c0694164038524faa0fa347709dc459fd929a3ae0f5839fcb72934de81d"} err="failed to get container status \"578b5c0694164038524faa0fa347709dc459fd929a3ae0f5839fcb72934de81d\": rpc error: code = NotFound desc = could not find container \"578b5c0694164038524faa0fa347709dc459fd929a3ae0f5839fcb72934de81d\": container with ID starting with 578b5c0694164038524faa0fa347709dc459fd929a3ae0f5839fcb72934de81d not found: ID does not exist"
Sep 06 10:24:32.764434 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.764403    2561 scope.go:117] "RemoveContainer" containerID="201637c4fee9b562554b0b6a2e726a585d0610fd4634ade4a40f8b1dfcd4d319"
Sep 06 10:24:32.764678 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:24:32.764661    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"201637c4fee9b562554b0b6a2e726a585d0610fd4634ade4a40f8b1dfcd4d319\": container with ID starting with 201637c4fee9b562554b0b6a2e726a585d0610fd4634ade4a40f8b1dfcd4d319 not found: ID does not exist" containerID="201637c4fee9b562554b0b6a2e726a585d0610fd4634ade4a40f8b1dfcd4d319"
Sep 06 10:24:32.764718 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.764690    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"201637c4fee9b562554b0b6a2e726a585d0610fd4634ade4a40f8b1dfcd4d319"} err="failed to get container status \"201637c4fee9b562554b0b6a2e726a585d0610fd4634ade4a40f8b1dfcd4d319\": rpc error: code = NotFound desc = could not find container \"201637c4fee9b562554b0b6a2e726a585d0610fd4634ade4a40f8b1dfcd4d319\": container with ID starting with 201637c4fee9b562554b0b6a2e726a585d0610fd4634ade4a40f8b1dfcd4d319 not found: ID does not exist"
Sep 06 10:24:32.764718 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.764706    2561 scope.go:117] "RemoveContainer" containerID="13d4dc64b8056ab8132b4746e60767213fe9acb47bc9c8712ccfaa07d8bbd127"
Sep 06 10:24:32.764942 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:24:32.764923    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13d4dc64b8056ab8132b4746e60767213fe9acb47bc9c8712ccfaa07d8bbd127\": container with ID starting with 13d4dc64b8056ab8132b4746e60767213fe9acb47bc9c8712ccfaa07d8bbd127 not found: ID does not exist" containerID="13d4dc64b8056ab8132b4746e60767213fe9acb47bc9c8712ccfaa07d8bbd127"
Sep 06 10:24:32.764981 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.764947    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13d4dc64b8056ab8132b4746e60767213fe9acb47bc9c8712ccfaa07d8bbd127"} err="failed to get container status \"13d4dc64b8056ab8132b4746e60767213fe9acb47bc9c8712ccfaa07d8bbd127\": rpc error: code = NotFound desc = could not find container \"13d4dc64b8056ab8132b4746e60767213fe9acb47bc9c8712ccfaa07d8bbd127\": container with ID starting with 13d4dc64b8056ab8132b4746e60767213fe9acb47bc9c8712ccfaa07d8bbd127 not found: ID does not exist"
Sep 06 10:24:32.764981 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.764961    2561 scope.go:117] "RemoveContainer" containerID="cca8df210968811786f58c0a58fd2adf8d89083fe4cb8af18bc5a830c51b5e33"
Sep 06 10:24:32.765224 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:24:32.765203    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cca8df210968811786f58c0a58fd2adf8d89083fe4cb8af18bc5a830c51b5e33\": container with ID starting with cca8df210968811786f58c0a58fd2adf8d89083fe4cb8af18bc5a830c51b5e33 not found: ID does not exist" containerID="cca8df210968811786f58c0a58fd2adf8d89083fe4cb8af18bc5a830c51b5e33"
Sep 06 10:24:32.765298 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.765227    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cca8df210968811786f58c0a58fd2adf8d89083fe4cb8af18bc5a830c51b5e33"} err="failed to get container status \"cca8df210968811786f58c0a58fd2adf8d89083fe4cb8af18bc5a830c51b5e33\": rpc error: code = NotFound desc = could not find container \"cca8df210968811786f58c0a58fd2adf8d89083fe4cb8af18bc5a830c51b5e33\": container with ID starting with cca8df210968811786f58c0a58fd2adf8d89083fe4cb8af18bc5a830c51b5e33 not found: ID does not exist"
Sep 06 10:24:32.765298 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.765244    2561 scope.go:117] "RemoveContainer" containerID="246385f9e5438f59f1ef0610714854cd64cc3f60b3b99b4b5213b7c93a925109"
Sep 06 10:24:32.765467 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.765449    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"246385f9e5438f59f1ef0610714854cd64cc3f60b3b99b4b5213b7c93a925109"} err="failed to get container status \"246385f9e5438f59f1ef0610714854cd64cc3f60b3b99b4b5213b7c93a925109\": rpc error: code = NotFound desc = could not find container \"246385f9e5438f59f1ef0610714854cd64cc3f60b3b99b4b5213b7c93a925109\": container with ID starting with 246385f9e5438f59f1ef0610714854cd64cc3f60b3b99b4b5213b7c93a925109 not found: ID does not exist"
Sep 06 10:24:32.765509 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.765469    2561 scope.go:117] "RemoveContainer" containerID="c6f50cbd7f13fb680330f9902d2225e5f00aa956d94faf20472b6dc746f8ed42"
Sep 06 10:24:32.765711 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.765694    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6f50cbd7f13fb680330f9902d2225e5f00aa956d94faf20472b6dc746f8ed42"} err="failed to get container status \"c6f50cbd7f13fb680330f9902d2225e5f00aa956d94faf20472b6dc746f8ed42\": rpc error: code = NotFound desc = could not find container \"c6f50cbd7f13fb680330f9902d2225e5f00aa956d94faf20472b6dc746f8ed42\": container with ID starting with c6f50cbd7f13fb680330f9902d2225e5f00aa956d94faf20472b6dc746f8ed42 not found: ID does not exist"
Sep 06 10:24:32.765754 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.765712    2561 scope.go:117] "RemoveContainer" containerID="7310581d36d44487921abf928c9501faf79ea755b4664993aa23650bfe996e7c"
Sep 06 10:24:32.765966 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.765949    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7310581d36d44487921abf928c9501faf79ea755b4664993aa23650bfe996e7c"} err="failed to get container status \"7310581d36d44487921abf928c9501faf79ea755b4664993aa23650bfe996e7c\": rpc error: code = NotFound desc = could not find container \"7310581d36d44487921abf928c9501faf79ea755b4664993aa23650bfe996e7c\": container with ID starting with 7310581d36d44487921abf928c9501faf79ea755b4664993aa23650bfe996e7c not found: ID does not exist"
Sep 06 10:24:32.766015 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.765966    2561 scope.go:117] "RemoveContainer" containerID="578b5c0694164038524faa0fa347709dc459fd929a3ae0f5839fcb72934de81d"
Sep 06 10:24:32.766185 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.766165    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"578b5c0694164038524faa0fa347709dc459fd929a3ae0f5839fcb72934de81d"} err="failed to get container status \"578b5c0694164038524faa0fa347709dc459fd929a3ae0f5839fcb72934de81d\": rpc error: code = NotFound desc = could not find container \"578b5c0694164038524faa0fa347709dc459fd929a3ae0f5839fcb72934de81d\": container with ID starting with 578b5c0694164038524faa0fa347709dc459fd929a3ae0f5839fcb72934de81d not found: ID does not exist"
Sep 06 10:24:32.766185 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.766184    2561 scope.go:117] "RemoveContainer" containerID="201637c4fee9b562554b0b6a2e726a585d0610fd4634ade4a40f8b1dfcd4d319"
Sep 06 10:24:32.766403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.766385    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"201637c4fee9b562554b0b6a2e726a585d0610fd4634ade4a40f8b1dfcd4d319"} err="failed to get container status \"201637c4fee9b562554b0b6a2e726a585d0610fd4634ade4a40f8b1dfcd4d319\": rpc error: code = NotFound desc = could not find container \"201637c4fee9b562554b0b6a2e726a585d0610fd4634ade4a40f8b1dfcd4d319\": container with ID starting with 201637c4fee9b562554b0b6a2e726a585d0610fd4634ade4a40f8b1dfcd4d319 not found: ID does not exist"
Sep 06 10:24:32.766452 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.766403    2561 scope.go:117] "RemoveContainer" containerID="13d4dc64b8056ab8132b4746e60767213fe9acb47bc9c8712ccfaa07d8bbd127"
Sep 06 10:24:32.766606 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.766592    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13d4dc64b8056ab8132b4746e60767213fe9acb47bc9c8712ccfaa07d8bbd127"} err="failed to get container status \"13d4dc64b8056ab8132b4746e60767213fe9acb47bc9c8712ccfaa07d8bbd127\": rpc error: code = NotFound desc = could not find container \"13d4dc64b8056ab8132b4746e60767213fe9acb47bc9c8712ccfaa07d8bbd127\": container with ID starting with 13d4dc64b8056ab8132b4746e60767213fe9acb47bc9c8712ccfaa07d8bbd127 not found: ID does not exist"
Sep 06 10:24:32.766650 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.766606    2561 scope.go:117] "RemoveContainer" containerID="cca8df210968811786f58c0a58fd2adf8d89083fe4cb8af18bc5a830c51b5e33"
Sep 06 10:24:32.766828 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.766810    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cca8df210968811786f58c0a58fd2adf8d89083fe4cb8af18bc5a830c51b5e33"} err="failed to get container status \"cca8df210968811786f58c0a58fd2adf8d89083fe4cb8af18bc5a830c51b5e33\": rpc error: code = NotFound desc = could not find container \"cca8df210968811786f58c0a58fd2adf8d89083fe4cb8af18bc5a830c51b5e33\": container with ID starting with cca8df210968811786f58c0a58fd2adf8d89083fe4cb8af18bc5a830c51b5e33 not found: ID does not exist"
Sep 06 10:24:32.772352 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772315    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 10:24:32.772603 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772592    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="kube-rbac-proxy"
Sep 06 10:24:32.772648 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772605    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="kube-rbac-proxy"
Sep 06 10:24:32.772648 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772613    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="prom-label-proxy"
Sep 06 10:24:32.772648 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772619    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="prom-label-proxy"
Sep 06 10:24:32.772648 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772625    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5bcfaad-879c-4173-816a-63ddf0252bec" containerName="registry"
Sep 06 10:24:32.772648 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772631    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5bcfaad-879c-4173-816a-63ddf0252bec" containerName="registry"
Sep 06 10:24:32.772648 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772636    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="kube-rbac-proxy-web"
Sep 06 10:24:32.772648 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772641    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="kube-rbac-proxy-web"
Sep 06 10:24:32.772648 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772650    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6385f70c-ceb6-4688-90ef-179c7678017c" containerName="console"
Sep 06 10:24:32.772906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772656    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6385f70c-ceb6-4688-90ef-179c7678017c" containerName="console"
Sep 06 10:24:32.772906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772667    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c635862e-8355-4312-ba8b-2fcba2bd6649" containerName="console"
Sep 06 10:24:32.772906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772672    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c635862e-8355-4312-ba8b-2fcba2bd6649" containerName="console"
Sep 06 10:24:32.772906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772680    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="kube-rbac-proxy-metric"
Sep 06 10:24:32.772906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772685    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="kube-rbac-proxy-metric"
Sep 06 10:24:32.772906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772692    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="config-reloader"
Sep 06 10:24:32.772906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772696    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="config-reloader"
Sep 06 10:24:32.772906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772702    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="init-config-reloader"
Sep 06 10:24:32.772906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772707    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="init-config-reloader"
Sep 06 10:24:32.772906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772719    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="alertmanager"
Sep 06 10:24:32.772906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772724    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="alertmanager"
Sep 06 10:24:32.772906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772766    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="kube-rbac-proxy-web"
Sep 06 10:24:32.772906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772773    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c635862e-8355-4312-ba8b-2fcba2bd6649" containerName="console"
Sep 06 10:24:32.772906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772780    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="alertmanager"
Sep 06 10:24:32.772906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772785    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="config-reloader"
Sep 06 10:24:32.772906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772791    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="kube-rbac-proxy"
Sep 06 10:24:32.772906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772795    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="kube-rbac-proxy-metric"
Sep 06 10:24:32.772906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772802    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5bcfaad-879c-4173-816a-63ddf0252bec" containerName="registry"
Sep 06 10:24:32.772906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772806    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6385f70c-ceb6-4688-90ef-179c7678017c" containerName="console"
Sep 06 10:24:32.772906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.772812    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a55c8e5-db73-4bd8-85b9-5965720f51ac" containerName="prom-label-proxy"
Sep 06 10:24:32.777601 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.777586    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.779762 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.779743    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 06 10:24:32.780037 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.780004    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 06 10:24:32.780108 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.780007    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 06 10:24:32.780108 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.780090    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 06 10:24:32.780233 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.780143    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 06 10:24:32.780233 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.780156    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 06 10:24:32.780233 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.780156    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2ff7c\""
Sep 06 10:24:32.780372 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.780281    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 06 10:24:32.780452 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.780434    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 06 10:24:32.785570 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.785549    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 06 10:24:32.790664 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.790646    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 10:24:32.896032 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.896000    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cb395480-ff5e-4361-9b72-4eca310e1099-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.896170 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.896046    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb395480-ff5e-4361-9b72-4eca310e1099-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.896170 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.896080    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.896170 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.896143    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb395480-ff5e-4361-9b72-4eca310e1099-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.896316 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.896174    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.896316 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.896210    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb395480-ff5e-4361-9b72-4eca310e1099-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.896316 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.896242    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.896316 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.896278    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-277nx\" (UniqueName: \"kubernetes.io/projected/cb395480-ff5e-4361-9b72-4eca310e1099-kube-api-access-277nx\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.896530 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.896362    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.896530 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.896464    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-config-volume\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.896530 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.896481    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb395480-ff5e-4361-9b72-4eca310e1099-config-out\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.896530 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.896496    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.896530 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.896517    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-web-config\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.997516 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.997451    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.997516 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.997483    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-config-volume\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.997516 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.997504    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb395480-ff5e-4361-9b72-4eca310e1099-config-out\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.997732 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.997521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.997732 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.997539    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-web-config\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.997732 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.997561    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cb395480-ff5e-4361-9b72-4eca310e1099-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.997732 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.997588    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb395480-ff5e-4361-9b72-4eca310e1099-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.997732 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.997619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.997732 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.997652    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb395480-ff5e-4361-9b72-4eca310e1099-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.997732 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.997677    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.997732 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.997704    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb395480-ff5e-4361-9b72-4eca310e1099-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.997732 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.997726    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.998158 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.997762    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-277nx\" (UniqueName: \"kubernetes.io/projected/cb395480-ff5e-4361-9b72-4eca310e1099-kube-api-access-277nx\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.998444 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.998417    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb395480-ff5e-4361-9b72-4eca310e1099-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.998901 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.998873    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb395480-ff5e-4361-9b72-4eca310e1099-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:32.999031 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:32.998873    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cb395480-ff5e-4361-9b72-4eca310e1099-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:33.000701 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:33.000656    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:33.000701 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:33.000684    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-web-config\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:33.001123 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:33.001098    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:33.001313 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:33.001259    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:33.001447 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:33.001428    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:33.001586 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:33.001562    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-config-volume\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:33.001685 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:33.001667    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb395480-ff5e-4361-9b72-4eca310e1099-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:33.001757 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:33.001741    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb395480-ff5e-4361-9b72-4eca310e1099-config-out\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:33.001790 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:33.001771    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb395480-ff5e-4361-9b72-4eca310e1099-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:33.006023 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:33.006000    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-277nx\" (UniqueName: \"kubernetes.io/projected/cb395480-ff5e-4361-9b72-4eca310e1099-kube-api-access-277nx\") pod \"alertmanager-main-0\" (UID: \"cb395480-ff5e-4361-9b72-4eca310e1099\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:33.086372 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:33.086339    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 06 10:24:33.364965 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:33.364940    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 06 10:24:33.366455 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:24:33.366433    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb395480_ff5e_4361_9b72_4eca310e1099.slice/crio-a0d14a37b66fe02be53940789859d093fed913c4cd47bdc6e75dd6e627123ce5 WatchSource:0}: Error finding container a0d14a37b66fe02be53940789859d093fed913c4cd47bdc6e75dd6e627123ce5: Status 404 returned error can't find the container with id a0d14a37b66fe02be53940789859d093fed913c4cd47bdc6e75dd6e627123ce5
Sep 06 10:24:33.721040 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:33.720992    2561 generic.go:356] "Generic (PLEG): container finished" podID="cb395480-ff5e-4361-9b72-4eca310e1099" containerID="b8e29e2499cfa61f3fc2259ecd0add25903c9ddf414728d6f599a6656d832356" exitCode=0
Sep 06 10:24:33.721494 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:33.721083    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb395480-ff5e-4361-9b72-4eca310e1099","Type":"ContainerDied","Data":"b8e29e2499cfa61f3fc2259ecd0add25903c9ddf414728d6f599a6656d832356"}
Sep 06 10:24:33.721494 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:33.721170    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb395480-ff5e-4361-9b72-4eca310e1099","Type":"ContainerStarted","Data":"a0d14a37b66fe02be53940789859d093fed913c4cd47bdc6e75dd6e627123ce5"}
Sep 06 10:24:34.730383 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:34.730352    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb395480-ff5e-4361-9b72-4eca310e1099","Type":"ContainerStarted","Data":"162b59418a23a533b46b28b3e7c825c74084baf7005dbb8db070b05e1fe1b81e"}
Sep 06 10:24:34.730733 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:34.730414    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb395480-ff5e-4361-9b72-4eca310e1099","Type":"ContainerStarted","Data":"91d185cdd9203befe007a31c3e65ed87dd0680596571d034c09bd6596a80c49b"}
Sep 06 10:24:34.730733 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:34.730440    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb395480-ff5e-4361-9b72-4eca310e1099","Type":"ContainerStarted","Data":"dd71b3119a81949cff2e424396724bdc282107e8e5819ecc6b5f504d95cb9268"}
Sep 06 10:24:34.730733 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:34.730464    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb395480-ff5e-4361-9b72-4eca310e1099","Type":"ContainerStarted","Data":"bce52431ba1b16406b469cef029ad5280ae9a2c0866bfb035eb2c1e907bfc700"}
Sep 06 10:24:34.730733 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:34.730486    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb395480-ff5e-4361-9b72-4eca310e1099","Type":"ContainerStarted","Data":"4939f3609c8b4df7b5ecaa309fe57c089f390d3df6f3120c493a87d7f45e98e9"}
Sep 06 10:24:34.730733 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:34.730509    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb395480-ff5e-4361-9b72-4eca310e1099","Type":"ContainerStarted","Data":"1433054860b8b01d4009146d849dd17559c13d0613a7c0f8116da64bf7edd29f"}
Sep 06 10:24:34.754843 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:34.754791    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.737890189 podStartE2EDuration="2.754777284s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.887095ms" isStatefulPod=false podCreationTimestamp="2026-09-06 10:24:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:24:34.753427999 +0000 UTC m=+166.531847410" watchObservedRunningTime="2026-09-06 10:24:34.754777284 +0000 UTC m=+166.533196734"
Sep 06 10:24:35.560937 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.560902    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9b6dfc968-fhdxh"]
Sep 06 10:24:35.564356 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.564309    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.575792 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.575760    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9b6dfc968-fhdxh"]
Sep 06 10:24:35.613718 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.613692    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:24:35.673525 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.673501    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:24:35.722461 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.722429    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crl6d\" (UniqueName: \"kubernetes.io/projected/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-kube-api-access-crl6d\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.722611 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.722476    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-console-oauth-config\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.722611 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.722543    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-service-ca\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.722611 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.722577    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-trusted-ca-bundle\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.722611 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.722602    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-console-serving-cert\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.722733 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.722617    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-oauth-serving-cert\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.722733 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.722660    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-console-config\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.824016 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.823924    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-service-ca\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.824016 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.823973    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-trusted-ca-bundle\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.824016 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.823996    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-console-serving-cert\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.824016 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.824018    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-oauth-serving-cert\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.824624 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.824049    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-console-config\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.824624 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.824091    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crl6d\" (UniqueName: \"kubernetes.io/projected/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-kube-api-access-crl6d\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.824624 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.824164    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-console-oauth-config\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.824788 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.824732    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-service-ca\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.824846 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.824810    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-oauth-serving-cert\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.824945 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.824922    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-console-config\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.824945 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.824932    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-trusted-ca-bundle\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.826504 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.826480    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-console-serving-cert\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.826585 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.826507    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-console-oauth-config\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.832965 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.832944    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crl6d\" (UniqueName: \"kubernetes.io/projected/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-kube-api-access-crl6d\") pod \"console-9b6dfc968-fhdxh\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") " pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:35.874834 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:35.874798    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:36.150239 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:36.150205    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9b6dfc968-fhdxh"]
Sep 06 10:24:36.151511 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:24:36.151480    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7fe04c3_c37f_4e09_8fbb_468275ae9f78.slice/crio-10f99b1e85b42fede329a20d9a48561e52259cb52551617482357222ea0e470d WatchSource:0}: Error finding container 10f99b1e85b42fede329a20d9a48561e52259cb52551617482357222ea0e470d: Status 404 returned error can't find the container with id 10f99b1e85b42fede329a20d9a48561e52259cb52551617482357222ea0e470d
Sep 06 10:24:36.742680 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:36.742640    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b6dfc968-fhdxh" event={"ID":"c7fe04c3-c37f-4e09-8fbb-468275ae9f78","Type":"ContainerStarted","Data":"2fff22bda4afc7cd51911137ec6955f2b49b229c9042780ce3683c2c1bfd4c21"}
Sep 06 10:24:36.742879 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:36.742697    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b6dfc968-fhdxh" event={"ID":"c7fe04c3-c37f-4e09-8fbb-468275ae9f78","Type":"ContainerStarted","Data":"10f99b1e85b42fede329a20d9a48561e52259cb52551617482357222ea0e470d"}
Sep 06 10:24:36.762691 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:36.762637    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9b6dfc968-fhdxh" podStartSLOduration=1.762621368 podStartE2EDuration="1.762621368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:24:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:24:36.760882315 +0000 UTC m=+168.539301727" watchObservedRunningTime="2026-09-06 10:24:36.762621368 +0000 UTC m=+168.541040780"
Sep 06 10:24:38.319638 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:38.319606    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:24:38.420518 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:38.420487    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:24:45.875208 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:45.875128    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:45.875208 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:45.875197    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:45.879726 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:45.879705    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:46.302005 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:46.301975    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:24:46.402475 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:46.402445    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:24:46.786475 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:46.786449    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:24:46.840514 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:46.840477    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85445594b7-qsssn"]
Sep 06 10:24:47.000602 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:47.000568    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:24:47.090042 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:47.089961    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:24:47.190759 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:24:47.190734    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:03.598508 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:03.598475    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:03.697071 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:03.697027    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:04.280818 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:04.280785    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2"]
Sep 06 10:25:04.285621 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:04.285599    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2"
Sep 06 10:25:04.288248 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:04.288223    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 06 10:25:04.288403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:04.288301    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 06 10:25:04.288866 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:04.288851    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bc9cp\""
Sep 06 10:25:04.296281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:04.296259    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2"]
Sep 06 10:25:04.358997 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:04.358962    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12195ca4-6bd6-44b7-957a-2065654b419b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2\" (UID: \"12195ca4-6bd6-44b7-957a-2065654b419b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2"
Sep 06 10:25:04.359181 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:04.359002    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nk5m\" (UniqueName: \"kubernetes.io/projected/12195ca4-6bd6-44b7-957a-2065654b419b-kube-api-access-7nk5m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2\" (UID: \"12195ca4-6bd6-44b7-957a-2065654b419b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2"
Sep 06 10:25:04.359181 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:04.359140    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12195ca4-6bd6-44b7-957a-2065654b419b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2\" (UID: \"12195ca4-6bd6-44b7-957a-2065654b419b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2"
Sep 06 10:25:04.460373 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:04.460345    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12195ca4-6bd6-44b7-957a-2065654b419b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2\" (UID: \"12195ca4-6bd6-44b7-957a-2065654b419b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2"
Sep 06 10:25:04.460534 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:04.460384    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12195ca4-6bd6-44b7-957a-2065654b419b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2\" (UID: \"12195ca4-6bd6-44b7-957a-2065654b419b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2"
Sep 06 10:25:04.460534 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:04.460405    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nk5m\" (UniqueName: \"kubernetes.io/projected/12195ca4-6bd6-44b7-957a-2065654b419b-kube-api-access-7nk5m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2\" (UID: \"12195ca4-6bd6-44b7-957a-2065654b419b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2"
Sep 06 10:25:04.460710 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:04.460690    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12195ca4-6bd6-44b7-957a-2065654b419b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2\" (UID: \"12195ca4-6bd6-44b7-957a-2065654b419b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2"
Sep 06 10:25:04.460777 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:04.460748    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12195ca4-6bd6-44b7-957a-2065654b419b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2\" (UID: \"12195ca4-6bd6-44b7-957a-2065654b419b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2"
Sep 06 10:25:04.469619 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:04.469597    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nk5m\" (UniqueName: \"kubernetes.io/projected/12195ca4-6bd6-44b7-957a-2065654b419b-kube-api-access-7nk5m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2\" (UID: \"12195ca4-6bd6-44b7-957a-2065654b419b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2"
Sep 06 10:25:04.594262 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:04.594193    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2"
Sep 06 10:25:04.861592 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:04.861569    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2"]
Sep 06 10:25:04.863953 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:25:04.863927    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12195ca4_6bd6_44b7_957a_2065654b419b.slice/crio-e5940af7bdd61151be3e613275062463ca39cf7b981d8781ccad4a4c4abac3fd WatchSource:0}: Error finding container e5940af7bdd61151be3e613275062463ca39cf7b981d8781ccad4a4c4abac3fd: Status 404 returned error can't find the container with id e5940af7bdd61151be3e613275062463ca39cf7b981d8781ccad4a4c4abac3fd
Sep 06 10:25:05.860698 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:05.860658    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2" event={"ID":"12195ca4-6bd6-44b7-957a-2065654b419b","Type":"ContainerStarted","Data":"e5940af7bdd61151be3e613275062463ca39cf7b981d8781ccad4a4c4abac3fd"}
Sep 06 10:25:10.887385 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:10.887289    2561 generic.go:356] "Generic (PLEG): container finished" podID="12195ca4-6bd6-44b7-957a-2065654b419b" containerID="b1c9f6b268444610767e663f8c467701a2e6a1e2496f957ac69881c1f922ff80" exitCode=0
Sep 06 10:25:10.887730 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:10.887380    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2" event={"ID":"12195ca4-6bd6-44b7-957a-2065654b419b","Type":"ContainerDied","Data":"b1c9f6b268444610767e663f8c467701a2e6a1e2496f957ac69881c1f922ff80"}
Sep 06 10:25:11.866594 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:11.866551    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85445594b7-qsssn" podUID="b5390554-5f42-4be1-bc2d-8aac5accaec8" containerName="console" containerID="cri-o://8c4184776856c62384d0576757854c8db5793fb5b3a8d3f63a5835bd0de854cb" gracePeriod=15
Sep 06 10:25:12.129893 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.129840    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:25:12.227504 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.227469    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-oauth-serving-cert\") pod \"b5390554-5f42-4be1-bc2d-8aac5accaec8\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") "
Sep 06 10:25:12.227685 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.227528    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-trusted-ca-bundle\") pod \"b5390554-5f42-4be1-bc2d-8aac5accaec8\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") "
Sep 06 10:25:12.227685 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.227582    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-console-config\") pod \"b5390554-5f42-4be1-bc2d-8aac5accaec8\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") "
Sep 06 10:25:12.227685 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.227630    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5390554-5f42-4be1-bc2d-8aac5accaec8-console-oauth-config\") pod \"b5390554-5f42-4be1-bc2d-8aac5accaec8\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") "
Sep 06 10:25:12.227685 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.227666    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5390554-5f42-4be1-bc2d-8aac5accaec8-console-serving-cert\") pod \"b5390554-5f42-4be1-bc2d-8aac5accaec8\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") "
Sep 06 10:25:12.227928 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.227692    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kd8k4\" (UniqueName: \"kubernetes.io/projected/b5390554-5f42-4be1-bc2d-8aac5accaec8-kube-api-access-kd8k4\") pod \"b5390554-5f42-4be1-bc2d-8aac5accaec8\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") "
Sep 06 10:25:12.227928 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.227724    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-service-ca\") pod \"b5390554-5f42-4be1-bc2d-8aac5accaec8\" (UID: \"b5390554-5f42-4be1-bc2d-8aac5accaec8\") "
Sep 06 10:25:12.228037 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.227986    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b5390554-5f42-4be1-bc2d-8aac5accaec8" (UID: "b5390554-5f42-4be1-bc2d-8aac5accaec8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:25:12.228037 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.227981    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b5390554-5f42-4be1-bc2d-8aac5accaec8" (UID: "b5390554-5f42-4be1-bc2d-8aac5accaec8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:25:12.228137 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.228055    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-console-config" (OuterVolumeSpecName: "console-config") pod "b5390554-5f42-4be1-bc2d-8aac5accaec8" (UID: "b5390554-5f42-4be1-bc2d-8aac5accaec8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:25:12.228299 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.228273    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-service-ca" (OuterVolumeSpecName: "service-ca") pod "b5390554-5f42-4be1-bc2d-8aac5accaec8" (UID: "b5390554-5f42-4be1-bc2d-8aac5accaec8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:25:12.230174 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.230137    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5390554-5f42-4be1-bc2d-8aac5accaec8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b5390554-5f42-4be1-bc2d-8aac5accaec8" (UID: "b5390554-5f42-4be1-bc2d-8aac5accaec8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 10:25:12.230298 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.230269    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5390554-5f42-4be1-bc2d-8aac5accaec8-kube-api-access-kd8k4" (OuterVolumeSpecName: "kube-api-access-kd8k4") pod "b5390554-5f42-4be1-bc2d-8aac5accaec8" (UID: "b5390554-5f42-4be1-bc2d-8aac5accaec8"). InnerVolumeSpecName "kube-api-access-kd8k4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:25:12.230378 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.230273    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5390554-5f42-4be1-bc2d-8aac5accaec8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b5390554-5f42-4be1-bc2d-8aac5accaec8" (UID: "b5390554-5f42-4be1-bc2d-8aac5accaec8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 10:25:12.329108 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.329064    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-trusted-ca-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:25:12.329108 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.329104    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-console-config\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:25:12.329108 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.329115    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5390554-5f42-4be1-bc2d-8aac5accaec8-console-oauth-config\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:25:12.329354 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.329123    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5390554-5f42-4be1-bc2d-8aac5accaec8-console-serving-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:25:12.329354 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.329134    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kd8k4\" (UniqueName: \"kubernetes.io/projected/b5390554-5f42-4be1-bc2d-8aac5accaec8-kube-api-access-kd8k4\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:25:12.329354 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.329148    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:25:12.329354 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.329161    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5390554-5f42-4be1-bc2d-8aac5accaec8-oauth-serving-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:25:12.897730 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.897690    2561 generic.go:356] "Generic (PLEG): container finished" podID="b5390554-5f42-4be1-bc2d-8aac5accaec8" containerID="8c4184776856c62384d0576757854c8db5793fb5b3a8d3f63a5835bd0de854cb" exitCode=0
Sep 06 10:25:12.897888 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.897737    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85445594b7-qsssn"
Sep 06 10:25:12.897888 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.897769    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85445594b7-qsssn" event={"ID":"b5390554-5f42-4be1-bc2d-8aac5accaec8","Type":"ContainerDied","Data":"8c4184776856c62384d0576757854c8db5793fb5b3a8d3f63a5835bd0de854cb"}
Sep 06 10:25:12.897888 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.897822    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85445594b7-qsssn" event={"ID":"b5390554-5f42-4be1-bc2d-8aac5accaec8","Type":"ContainerDied","Data":"7bc434f6338abf91b80358130c4b0d6e8cbc06d39a4b0e6083277c63eec0c21c"}
Sep 06 10:25:12.897888 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.897848    2561 scope.go:117] "RemoveContainer" containerID="8c4184776856c62384d0576757854c8db5793fb5b3a8d3f63a5835bd0de854cb"
Sep 06 10:25:12.906073 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.906041    2561 scope.go:117] "RemoveContainer" containerID="8c4184776856c62384d0576757854c8db5793fb5b3a8d3f63a5835bd0de854cb"
Sep 06 10:25:12.906310 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:25:12.906293    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c4184776856c62384d0576757854c8db5793fb5b3a8d3f63a5835bd0de854cb\": container with ID starting with 8c4184776856c62384d0576757854c8db5793fb5b3a8d3f63a5835bd0de854cb not found: ID does not exist" containerID="8c4184776856c62384d0576757854c8db5793fb5b3a8d3f63a5835bd0de854cb"
Sep 06 10:25:12.906381 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.906317    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c4184776856c62384d0576757854c8db5793fb5b3a8d3f63a5835bd0de854cb"} err="failed to get container status \"8c4184776856c62384d0576757854c8db5793fb5b3a8d3f63a5835bd0de854cb\": rpc error: code = NotFound desc = could not find container \"8c4184776856c62384d0576757854c8db5793fb5b3a8d3f63a5835bd0de854cb\": container with ID starting with 8c4184776856c62384d0576757854c8db5793fb5b3a8d3f63a5835bd0de854cb not found: ID does not exist"
Sep 06 10:25:12.914644 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.914619    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85445594b7-qsssn"]
Sep 06 10:25:12.916985 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:12.916964    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85445594b7-qsssn"]
Sep 06 10:25:13.904666 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:13.904635    2561 generic.go:356] "Generic (PLEG): container finished" podID="12195ca4-6bd6-44b7-957a-2065654b419b" containerID="69bcd3bd09859a1c95ee86613d01bae528336ba803e998cd6085ee2cfd76091b" exitCode=0
Sep 06 10:25:13.905017 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:13.904694    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2" event={"ID":"12195ca4-6bd6-44b7-957a-2065654b419b","Type":"ContainerDied","Data":"69bcd3bd09859a1c95ee86613d01bae528336ba803e998cd6085ee2cfd76091b"}
Sep 06 10:25:14.755823 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:14.755661    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5390554-5f42-4be1-bc2d-8aac5accaec8" path="/var/lib/kubelet/pods/b5390554-5f42-4be1-bc2d-8aac5accaec8/volumes"
Sep 06 10:25:20.936834 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:20.936797    2561 generic.go:356] "Generic (PLEG): container finished" podID="12195ca4-6bd6-44b7-957a-2065654b419b" containerID="04d57fc364ceda892054b05498b6ff58d87b564158ba41bce9410e9cc0131934" exitCode=0
Sep 06 10:25:20.937230 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:20.936865    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2" event={"ID":"12195ca4-6bd6-44b7-957a-2065654b419b","Type":"ContainerDied","Data":"04d57fc364ceda892054b05498b6ff58d87b564158ba41bce9410e9cc0131934"}
Sep 06 10:25:22.062401 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:22.062377    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2"
Sep 06 10:25:22.212451 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:22.212367    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12195ca4-6bd6-44b7-957a-2065654b419b-util\") pod \"12195ca4-6bd6-44b7-957a-2065654b419b\" (UID: \"12195ca4-6bd6-44b7-957a-2065654b419b\") "
Sep 06 10:25:22.212451 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:22.212439    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12195ca4-6bd6-44b7-957a-2065654b419b-bundle\") pod \"12195ca4-6bd6-44b7-957a-2065654b419b\" (UID: \"12195ca4-6bd6-44b7-957a-2065654b419b\") "
Sep 06 10:25:22.212620 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:22.212477    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nk5m\" (UniqueName: \"kubernetes.io/projected/12195ca4-6bd6-44b7-957a-2065654b419b-kube-api-access-7nk5m\") pod \"12195ca4-6bd6-44b7-957a-2065654b419b\" (UID: \"12195ca4-6bd6-44b7-957a-2065654b419b\") "
Sep 06 10:25:22.213087 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:22.213063    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12195ca4-6bd6-44b7-957a-2065654b419b-bundle" (OuterVolumeSpecName: "bundle") pod "12195ca4-6bd6-44b7-957a-2065654b419b" (UID: "12195ca4-6bd6-44b7-957a-2065654b419b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:25:22.214666 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:22.214639    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12195ca4-6bd6-44b7-957a-2065654b419b-kube-api-access-7nk5m" (OuterVolumeSpecName: "kube-api-access-7nk5m") pod "12195ca4-6bd6-44b7-957a-2065654b419b" (UID: "12195ca4-6bd6-44b7-957a-2065654b419b"). InnerVolumeSpecName "kube-api-access-7nk5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:25:22.217234 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:22.217214    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12195ca4-6bd6-44b7-957a-2065654b419b-util" (OuterVolumeSpecName: "util") pod "12195ca4-6bd6-44b7-957a-2065654b419b" (UID: "12195ca4-6bd6-44b7-957a-2065654b419b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:25:22.313148 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:22.313122    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12195ca4-6bd6-44b7-957a-2065654b419b-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:25:22.313148 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:22.313146    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nk5m\" (UniqueName: \"kubernetes.io/projected/12195ca4-6bd6-44b7-957a-2065654b419b-kube-api-access-7nk5m\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:25:22.313283 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:22.313156    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12195ca4-6bd6-44b7-957a-2065654b419b-util\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:25:22.947102 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:22.947074    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2"
Sep 06 10:25:22.947270 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:22.947071    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t7vf2" event={"ID":"12195ca4-6bd6-44b7-957a-2065654b419b","Type":"ContainerDied","Data":"e5940af7bdd61151be3e613275062463ca39cf7b981d8781ccad4a4c4abac3fd"}
Sep 06 10:25:22.947270 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:22.947188    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5940af7bdd61151be3e613275062463ca39cf7b981d8781ccad4a4c4abac3fd"
Sep 06 10:25:25.264192 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:25.264162    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:26.094069 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:26.094032    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:27.273654 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.273618    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lwdms"]
Sep 06 10:25:27.273995 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.273902    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5390554-5f42-4be1-bc2d-8aac5accaec8" containerName="console"
Sep 06 10:25:27.273995 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.273912    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5390554-5f42-4be1-bc2d-8aac5accaec8" containerName="console"
Sep 06 10:25:27.273995 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.273924    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12195ca4-6bd6-44b7-957a-2065654b419b" containerName="util"
Sep 06 10:25:27.273995 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.273930    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="12195ca4-6bd6-44b7-957a-2065654b419b" containerName="util"
Sep 06 10:25:27.273995 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.273940    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12195ca4-6bd6-44b7-957a-2065654b419b" containerName="extract"
Sep 06 10:25:27.273995 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.273946    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="12195ca4-6bd6-44b7-957a-2065654b419b" containerName="extract"
Sep 06 10:25:27.273995 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.273953    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12195ca4-6bd6-44b7-957a-2065654b419b" containerName="pull"
Sep 06 10:25:27.273995 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.273960    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="12195ca4-6bd6-44b7-957a-2065654b419b" containerName="pull"
Sep 06 10:25:27.274243 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.274014    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="12195ca4-6bd6-44b7-957a-2065654b419b" containerName="extract"
Sep 06 10:25:27.274243 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.274025    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5390554-5f42-4be1-bc2d-8aac5accaec8" containerName="console"
Sep 06 10:25:27.305843 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.305818    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lwdms"]
Sep 06 10:25:27.305976 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.305904    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lwdms"
Sep 06 10:25:27.308720 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.308700    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 06 10:25:27.308832 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.308812    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 06 10:25:27.308888 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.308819    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-854h6\""
Sep 06 10:25:27.458239 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.458208    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49rbm\" (UniqueName: \"kubernetes.io/projected/5dab10b2-c4eb-490b-9e60-8f6cb0d541cb-kube-api-access-49rbm\") pod \"cert-manager-operator-controller-manager-55c444bf86-lwdms\" (UID: \"5dab10b2-c4eb-490b-9e60-8f6cb0d541cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lwdms"
Sep 06 10:25:27.458406 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.458287    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5dab10b2-c4eb-490b-9e60-8f6cb0d541cb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lwdms\" (UID: \"5dab10b2-c4eb-490b-9e60-8f6cb0d541cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lwdms"
Sep 06 10:25:27.559726 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.559640    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49rbm\" (UniqueName: \"kubernetes.io/projected/5dab10b2-c4eb-490b-9e60-8f6cb0d541cb-kube-api-access-49rbm\") pod \"cert-manager-operator-controller-manager-55c444bf86-lwdms\" (UID: \"5dab10b2-c4eb-490b-9e60-8f6cb0d541cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lwdms"
Sep 06 10:25:27.559907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.559722    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5dab10b2-c4eb-490b-9e60-8f6cb0d541cb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lwdms\" (UID: \"5dab10b2-c4eb-490b-9e60-8f6cb0d541cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lwdms"
Sep 06 10:25:27.560135 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.560113    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5dab10b2-c4eb-490b-9e60-8f6cb0d541cb-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lwdms\" (UID: \"5dab10b2-c4eb-490b-9e60-8f6cb0d541cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lwdms"
Sep 06 10:25:27.568360 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.568339    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49rbm\" (UniqueName: \"kubernetes.io/projected/5dab10b2-c4eb-490b-9e60-8f6cb0d541cb-kube-api-access-49rbm\") pod \"cert-manager-operator-controller-manager-55c444bf86-lwdms\" (UID: \"5dab10b2-c4eb-490b-9e60-8f6cb0d541cb\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lwdms"
Sep 06 10:25:27.615455 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.615424    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lwdms"
Sep 06 10:25:27.919198 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.919172    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lwdms"]
Sep 06 10:25:27.921121 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:25:27.921096    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dab10b2_c4eb_490b_9e60_8f6cb0d541cb.slice/crio-7e771314cbecaf9e7d4db31e90806ab3277e34295e9660ca836c2168dbfad2c3 WatchSource:0}: Error finding container 7e771314cbecaf9e7d4db31e90806ab3277e34295e9660ca836c2168dbfad2c3: Status 404 returned error can't find the container with id 7e771314cbecaf9e7d4db31e90806ab3277e34295e9660ca836c2168dbfad2c3
Sep 06 10:25:27.966194 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:27.966163    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lwdms" event={"ID":"5dab10b2-c4eb-490b-9e60-8f6cb0d541cb","Type":"ContainerStarted","Data":"7e771314cbecaf9e7d4db31e90806ab3277e34295e9660ca836c2168dbfad2c3"}
Sep 06 10:25:28.880827 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:28.880798    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:28.998361 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:28.998309    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:30.988362 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:30.988302    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lwdms" event={"ID":"5dab10b2-c4eb-490b-9e60-8f6cb0d541cb","Type":"ContainerStarted","Data":"42426dfd98e166c73b33bba542175e7d62cb93de31799a5c92bb066103e49c16"}
Sep 06 10:25:31.011386 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:31.011316    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lwdms" podStartSLOduration=1.617508954 podStartE2EDuration="4.01130149s" totalImagesPullingTime="2.393792536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:25:31.009218962 +0000 UTC m=+222.787638374" watchObservedRunningTime="2026-09-06 10:25:31.01130149 +0000 UTC m=+222.789720901"
Sep 06 10:25:31.155310 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:31.155280    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:31.257182 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:31.257106    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:31.444350 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:31.444302    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:31.565249 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:31.565174    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:31.779691 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:31.779658    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm"]
Sep 06 10:25:31.801014 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:31.800988    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm"]
Sep 06 10:25:31.801184 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:31.801097    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm"
Sep 06 10:25:31.803485 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:31.803461    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 06 10:25:31.803485 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:31.803465    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 06 10:25:31.804135 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:31.804116    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bc9cp\""
Sep 06 10:25:31.993869 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:31.993838    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18bb8d15-acf7-4d6c-9485-dfae8f2018ae-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm\" (UID: \"18bb8d15-acf7-4d6c-9485-dfae8f2018ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm"
Sep 06 10:25:31.993869 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:31.993873    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr7ws\" (UniqueName: \"kubernetes.io/projected/18bb8d15-acf7-4d6c-9485-dfae8f2018ae-kube-api-access-qr7ws\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm\" (UID: \"18bb8d15-acf7-4d6c-9485-dfae8f2018ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm"
Sep 06 10:25:31.994268 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:31.993950    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18bb8d15-acf7-4d6c-9485-dfae8f2018ae-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm\" (UID: \"18bb8d15-acf7-4d6c-9485-dfae8f2018ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm"
Sep 06 10:25:32.094685 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:32.094653    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18bb8d15-acf7-4d6c-9485-dfae8f2018ae-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm\" (UID: \"18bb8d15-acf7-4d6c-9485-dfae8f2018ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm"
Sep 06 10:25:32.094838 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:32.094706    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18bb8d15-acf7-4d6c-9485-dfae8f2018ae-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm\" (UID: \"18bb8d15-acf7-4d6c-9485-dfae8f2018ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm"
Sep 06 10:25:32.094838 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:32.094732    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr7ws\" (UniqueName: \"kubernetes.io/projected/18bb8d15-acf7-4d6c-9485-dfae8f2018ae-kube-api-access-qr7ws\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm\" (UID: \"18bb8d15-acf7-4d6c-9485-dfae8f2018ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm"
Sep 06 10:25:32.095118 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:32.095100    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18bb8d15-acf7-4d6c-9485-dfae8f2018ae-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm\" (UID: \"18bb8d15-acf7-4d6c-9485-dfae8f2018ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm"
Sep 06 10:25:32.095155 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:32.095122    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18bb8d15-acf7-4d6c-9485-dfae8f2018ae-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm\" (UID: \"18bb8d15-acf7-4d6c-9485-dfae8f2018ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm"
Sep 06 10:25:32.104394 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:32.104361    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr7ws\" (UniqueName: \"kubernetes.io/projected/18bb8d15-acf7-4d6c-9485-dfae8f2018ae-kube-api-access-qr7ws\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm\" (UID: \"18bb8d15-acf7-4d6c-9485-dfae8f2018ae\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm"
Sep 06 10:25:32.110092 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:32.110062    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm"
Sep 06 10:25:32.409637 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:32.409615    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm"]
Sep 06 10:25:32.412023 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:25:32.411992    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18bb8d15_acf7_4d6c_9485_dfae8f2018ae.slice/crio-01dfc9bb7a6fc90d8fc09bec0fbccdaab3295916a0a5d1d6f83a60c58a179ed1 WatchSource:0}: Error finding container 01dfc9bb7a6fc90d8fc09bec0fbccdaab3295916a0a5d1d6f83a60c58a179ed1: Status 404 returned error can't find the container with id 01dfc9bb7a6fc90d8fc09bec0fbccdaab3295916a0a5d1d6f83a60c58a179ed1
Sep 06 10:25:32.997838 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:32.997808    2561 generic.go:356] "Generic (PLEG): container finished" podID="18bb8d15-acf7-4d6c-9485-dfae8f2018ae" containerID="67cf87c56e618f45636e21e01ed265bab9249dc111ba3408c95433e6fdc5c8bc" exitCode=0
Sep 06 10:25:32.998309 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:32.997866    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm" event={"ID":"18bb8d15-acf7-4d6c-9485-dfae8f2018ae","Type":"ContainerDied","Data":"67cf87c56e618f45636e21e01ed265bab9249dc111ba3408c95433e6fdc5c8bc"}
Sep 06 10:25:32.998309 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:32.997907    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm" event={"ID":"18bb8d15-acf7-4d6c-9485-dfae8f2018ae","Type":"ContainerStarted","Data":"01dfc9bb7a6fc90d8fc09bec0fbccdaab3295916a0a5d1d6f83a60c58a179ed1"}
Sep 06 10:25:33.361380 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:33.361296    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:33.573122 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:33.573088    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:34.505453 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:34.505418    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:34.530396 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:34.530360    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tdt8b"]
Sep 06 10:25:34.536438 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:34.536406    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdt8b"
Sep 06 10:25:34.539071 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:34.539032    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 06 10:25:34.539206 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:34.539141    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 06 10:25:34.539704 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:34.539684    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-xvvg6\""
Sep 06 10:25:34.544045 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:34.544018    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tdt8b"]
Sep 06 10:25:34.614902 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:34.614864    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l24q9\" (UniqueName: \"kubernetes.io/projected/91ba5931-f0a0-4f68-881e-0aa4a0e1a45d-kube-api-access-l24q9\") pod \"cert-manager-cainjector-559cdd8c87-tdt8b\" (UID: \"91ba5931-f0a0-4f68-881e-0aa4a0e1a45d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdt8b"
Sep 06 10:25:34.615074 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:34.614982    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91ba5931-f0a0-4f68-881e-0aa4a0e1a45d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tdt8b\" (UID: \"91ba5931-f0a0-4f68-881e-0aa4a0e1a45d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdt8b"
Sep 06 10:25:34.716260 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:34.716218    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l24q9\" (UniqueName: \"kubernetes.io/projected/91ba5931-f0a0-4f68-881e-0aa4a0e1a45d-kube-api-access-l24q9\") pod \"cert-manager-cainjector-559cdd8c87-tdt8b\" (UID: \"91ba5931-f0a0-4f68-881e-0aa4a0e1a45d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdt8b"
Sep 06 10:25:34.716441 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:34.716339    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91ba5931-f0a0-4f68-881e-0aa4a0e1a45d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tdt8b\" (UID: \"91ba5931-f0a0-4f68-881e-0aa4a0e1a45d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdt8b"
Sep 06 10:25:34.728368 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:34.728317    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/91ba5931-f0a0-4f68-881e-0aa4a0e1a45d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-tdt8b\" (UID: \"91ba5931-f0a0-4f68-881e-0aa4a0e1a45d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdt8b"
Sep 06 10:25:34.728492 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:34.728417    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l24q9\" (UniqueName: \"kubernetes.io/projected/91ba5931-f0a0-4f68-881e-0aa4a0e1a45d-kube-api-access-l24q9\") pod \"cert-manager-cainjector-559cdd8c87-tdt8b\" (UID: \"91ba5931-f0a0-4f68-881e-0aa4a0e1a45d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdt8b"
Sep 06 10:25:34.857316 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:34.857250    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdt8b"
Sep 06 10:25:35.010218 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:35.010188    2561 generic.go:356] "Generic (PLEG): container finished" podID="18bb8d15-acf7-4d6c-9485-dfae8f2018ae" containerID="172c25674e529a6a3d96bdb83fa65174bc790495538a4cd0ff738a64f0de5634" exitCode=0
Sep 06 10:25:35.010377 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:35.010262    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm" event={"ID":"18bb8d15-acf7-4d6c-9485-dfae8f2018ae","Type":"ContainerDied","Data":"172c25674e529a6a3d96bdb83fa65174bc790495538a4cd0ff738a64f0de5634"}
Sep 06 10:25:35.140531 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:35.140504    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-tdt8b"]
Sep 06 10:25:35.142086 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:25:35.142059    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91ba5931_f0a0_4f68_881e_0aa4a0e1a45d.slice/crio-ef13bb3f98d82791a1cc78bfb5321063a7891b7e31a5241ae0e690357c5cd2af WatchSource:0}: Error finding container ef13bb3f98d82791a1cc78bfb5321063a7891b7e31a5241ae0e690357c5cd2af: Status 404 returned error can't find the container with id ef13bb3f98d82791a1cc78bfb5321063a7891b7e31a5241ae0e690357c5cd2af
Sep 06 10:25:35.468020 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:35.467993    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:35.569092 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:35.569061    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:36.016758 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:36.016670    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdt8b" event={"ID":"91ba5931-f0a0-4f68-881e-0aa4a0e1a45d","Type":"ContainerStarted","Data":"ef13bb3f98d82791a1cc78bfb5321063a7891b7e31a5241ae0e690357c5cd2af"}
Sep 06 10:25:36.019202 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:36.019161    2561 generic.go:356] "Generic (PLEG): container finished" podID="18bb8d15-acf7-4d6c-9485-dfae8f2018ae" containerID="9aed5714c68233609083432e4cd278a7554ee29bf66bed770deb72340856ca39" exitCode=0
Sep 06 10:25:36.019371 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:36.019246    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm" event={"ID":"18bb8d15-acf7-4d6c-9485-dfae8f2018ae","Type":"ContainerDied","Data":"9aed5714c68233609083432e4cd278a7554ee29bf66bed770deb72340856ca39"}
Sep 06 10:25:37.768206 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:37.768182    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm"
Sep 06 10:25:37.844367 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:37.844344    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18bb8d15-acf7-4d6c-9485-dfae8f2018ae-util\") pod \"18bb8d15-acf7-4d6c-9485-dfae8f2018ae\" (UID: \"18bb8d15-acf7-4d6c-9485-dfae8f2018ae\") "
Sep 06 10:25:37.844478 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:37.844415    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qr7ws\" (UniqueName: \"kubernetes.io/projected/18bb8d15-acf7-4d6c-9485-dfae8f2018ae-kube-api-access-qr7ws\") pod \"18bb8d15-acf7-4d6c-9485-dfae8f2018ae\" (UID: \"18bb8d15-acf7-4d6c-9485-dfae8f2018ae\") "
Sep 06 10:25:37.844478 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:37.844454    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18bb8d15-acf7-4d6c-9485-dfae8f2018ae-bundle\") pod \"18bb8d15-acf7-4d6c-9485-dfae8f2018ae\" (UID: \"18bb8d15-acf7-4d6c-9485-dfae8f2018ae\") "
Sep 06 10:25:37.844882 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:37.844857    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bb8d15-acf7-4d6c-9485-dfae8f2018ae-bundle" (OuterVolumeSpecName: "bundle") pod "18bb8d15-acf7-4d6c-9485-dfae8f2018ae" (UID: "18bb8d15-acf7-4d6c-9485-dfae8f2018ae"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:25:37.846497 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:37.846476    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18bb8d15-acf7-4d6c-9485-dfae8f2018ae-kube-api-access-qr7ws" (OuterVolumeSpecName: "kube-api-access-qr7ws") pod "18bb8d15-acf7-4d6c-9485-dfae8f2018ae" (UID: "18bb8d15-acf7-4d6c-9485-dfae8f2018ae"). InnerVolumeSpecName "kube-api-access-qr7ws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:25:37.850473 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:37.850447    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18bb8d15-acf7-4d6c-9485-dfae8f2018ae-util" (OuterVolumeSpecName: "util") pod "18bb8d15-acf7-4d6c-9485-dfae8f2018ae" (UID: "18bb8d15-acf7-4d6c-9485-dfae8f2018ae"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:25:37.945096 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:37.945064    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qr7ws\" (UniqueName: \"kubernetes.io/projected/18bb8d15-acf7-4d6c-9485-dfae8f2018ae-kube-api-access-qr7ws\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:25:37.945096 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:37.945092    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/18bb8d15-acf7-4d6c-9485-dfae8f2018ae-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:25:37.945237 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:37.945105    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/18bb8d15-acf7-4d6c-9485-dfae8f2018ae-util\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:25:38.030379 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:38.030283    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdt8b" event={"ID":"91ba5931-f0a0-4f68-881e-0aa4a0e1a45d","Type":"ContainerStarted","Data":"528ffd2178a48237ad681bbd1201d3f3f41d1ac86ee25760b30bbc26f2859522"}
Sep 06 10:25:38.032341 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:38.032301    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm"
Sep 06 10:25:38.032471 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:38.032298    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f42szm" event={"ID":"18bb8d15-acf7-4d6c-9485-dfae8f2018ae","Type":"ContainerDied","Data":"01dfc9bb7a6fc90d8fc09bec0fbccdaab3295916a0a5d1d6f83a60c58a179ed1"}
Sep 06 10:25:38.032471 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:38.032445    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01dfc9bb7a6fc90d8fc09bec0fbccdaab3295916a0a5d1d6f83a60c58a179ed1"
Sep 06 10:25:38.048971 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:38.048919    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-tdt8b" podStartSLOduration=1.358279891 podStartE2EDuration="4.048900264s" totalImagesPullingTime="2.690620373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:25:38.047436414 +0000 UTC m=+229.825855827" watchObservedRunningTime="2026-09-06 10:25:38.048900264 +0000 UTC m=+229.827319677"
Sep 06 10:25:38.933825 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:38.933797    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ff69g"]
Sep 06 10:25:38.934179 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:38.934084    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18bb8d15-acf7-4d6c-9485-dfae8f2018ae" containerName="pull"
Sep 06 10:25:38.934179 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:38.934097    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="18bb8d15-acf7-4d6c-9485-dfae8f2018ae" containerName="pull"
Sep 06 10:25:38.934179 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:38.934110    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18bb8d15-acf7-4d6c-9485-dfae8f2018ae" containerName="extract"
Sep 06 10:25:38.934179 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:38.934115    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="18bb8d15-acf7-4d6c-9485-dfae8f2018ae" containerName="extract"
Sep 06 10:25:38.934179 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:38.934128    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18bb8d15-acf7-4d6c-9485-dfae8f2018ae" containerName="util"
Sep 06 10:25:38.934179 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:38.934133    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="18bb8d15-acf7-4d6c-9485-dfae8f2018ae" containerName="util"
Sep 06 10:25:38.934370 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:38.934189    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="18bb8d15-acf7-4d6c-9485-dfae8f2018ae" containerName="extract"
Sep 06 10:25:38.937293 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:38.937275    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ff69g"
Sep 06 10:25:38.940384 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:38.940367    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-kdbt9\""
Sep 06 10:25:38.949143 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:38.949121    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ff69g"]
Sep 06 10:25:38.952493 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:38.952471    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c32729e0-7b75-4160-92c9-6a80b60f236a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ff69g\" (UID: \"c32729e0-7b75-4160-92c9-6a80b60f236a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ff69g"
Sep 06 10:25:38.952588 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:38.952505    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fmvh\" (UniqueName: \"kubernetes.io/projected/c32729e0-7b75-4160-92c9-6a80b60f236a-kube-api-access-6fmvh\") pod \"cert-manager-webhook-6486ffd997-ff69g\" (UID: \"c32729e0-7b75-4160-92c9-6a80b60f236a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ff69g"
Sep 06 10:25:39.053726 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:39.053689    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c32729e0-7b75-4160-92c9-6a80b60f236a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ff69g\" (UID: \"c32729e0-7b75-4160-92c9-6a80b60f236a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ff69g"
Sep 06 10:25:39.053726 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:39.053730    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fmvh\" (UniqueName: \"kubernetes.io/projected/c32729e0-7b75-4160-92c9-6a80b60f236a-kube-api-access-6fmvh\") pod \"cert-manager-webhook-6486ffd997-ff69g\" (UID: \"c32729e0-7b75-4160-92c9-6a80b60f236a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ff69g"
Sep 06 10:25:39.062618 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:39.062595    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c32729e0-7b75-4160-92c9-6a80b60f236a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-ff69g\" (UID: \"c32729e0-7b75-4160-92c9-6a80b60f236a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ff69g"
Sep 06 10:25:39.062816 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:39.062796    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fmvh\" (UniqueName: \"kubernetes.io/projected/c32729e0-7b75-4160-92c9-6a80b60f236a-kube-api-access-6fmvh\") pod \"cert-manager-webhook-6486ffd997-ff69g\" (UID: \"c32729e0-7b75-4160-92c9-6a80b60f236a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-ff69g"
Sep 06 10:25:39.245858 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:39.245766    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-ff69g"
Sep 06 10:25:39.522384 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:39.522360    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-ff69g"]
Sep 06 10:25:39.524173 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:25:39.524145    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc32729e0_7b75_4160_92c9_6a80b60f236a.slice/crio-51552a661b156268a808d974790bc6df5fe6fb093fe1bff62cb30eff9902de72 WatchSource:0}: Error finding container 51552a661b156268a808d974790bc6df5fe6fb093fe1bff62cb30eff9902de72: Status 404 returned error can't find the container with id 51552a661b156268a808d974790bc6df5fe6fb093fe1bff62cb30eff9902de72
Sep 06 10:25:39.768317 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:39.768282    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:39.869302 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:39.869232    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:40.042913 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:40.042875    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ff69g" event={"ID":"c32729e0-7b75-4160-92c9-6a80b60f236a","Type":"ContainerStarted","Data":"d5450714caadc2aced78c9c2b3a5396283c00b3ad7fa10183136639a43434e78"}
Sep 06 10:25:40.042913 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:40.042914    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-ff69g" event={"ID":"c32729e0-7b75-4160-92c9-6a80b60f236a","Type":"ContainerStarted","Data":"51552a661b156268a808d974790bc6df5fe6fb093fe1bff62cb30eff9902de72"}
Sep 06 10:25:40.043314 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:40.043042    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ff69g"
Sep 06 10:25:40.058996 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:40.058944    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-ff69g" podStartSLOduration=2.058931669 podStartE2EDuration="2.058931669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:25:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:25:40.057809336 +0000 UTC m=+231.836228748" watchObservedRunningTime="2026-09-06 10:25:40.058931669 +0000 UTC m=+231.837351081"
Sep 06 10:25:41.754220 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:41.754185    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:46.049082 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:46.049038    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-ff69g"
Sep 06 10:25:47.106795 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:47.106762    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:47.203606 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:47.203579    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:53.893648 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:53.893607    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:53.994130 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:53.994100    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:55.606460 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:55.606429    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:25:56.482552 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:56.482518    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm"]
Sep 06 10:25:56.487371 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:56.487352    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm"
Sep 06 10:25:56.489604 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:56.489579    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 06 10:25:56.490269 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:56.490248    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bc9cp\""
Sep 06 10:25:56.490371 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:56.490249    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 06 10:25:56.493476 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:56.493456    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm"]
Sep 06 10:25:56.589059 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:56.589019    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5trt\" (UniqueName: \"kubernetes.io/projected/8179aedc-25b5-4c57-a8fc-3bd4d22c5e24-kube-api-access-t5trt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm\" (UID: \"8179aedc-25b5-4c57-a8fc-3bd4d22c5e24\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm"
Sep 06 10:25:56.589167 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:56.589134    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8179aedc-25b5-4c57-a8fc-3bd4d22c5e24-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm\" (UID: \"8179aedc-25b5-4c57-a8fc-3bd4d22c5e24\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm"
Sep 06 10:25:56.589209 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:56.589168    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8179aedc-25b5-4c57-a8fc-3bd4d22c5e24-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm\" (UID: \"8179aedc-25b5-4c57-a8fc-3bd4d22c5e24\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm"
Sep 06 10:25:56.689768 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:56.689737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8179aedc-25b5-4c57-a8fc-3bd4d22c5e24-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm\" (UID: \"8179aedc-25b5-4c57-a8fc-3bd4d22c5e24\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm"
Sep 06 10:25:56.689768 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:56.689772    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8179aedc-25b5-4c57-a8fc-3bd4d22c5e24-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm\" (UID: \"8179aedc-25b5-4c57-a8fc-3bd4d22c5e24\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm"
Sep 06 10:25:56.690254 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:56.689795    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5trt\" (UniqueName: \"kubernetes.io/projected/8179aedc-25b5-4c57-a8fc-3bd4d22c5e24-kube-api-access-t5trt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm\" (UID: \"8179aedc-25b5-4c57-a8fc-3bd4d22c5e24\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm"
Sep 06 10:25:56.690254 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:56.690107    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8179aedc-25b5-4c57-a8fc-3bd4d22c5e24-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm\" (UID: \"8179aedc-25b5-4c57-a8fc-3bd4d22c5e24\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm"
Sep 06 10:25:56.690370 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:56.690245    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8179aedc-25b5-4c57-a8fc-3bd4d22c5e24-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm\" (UID: \"8179aedc-25b5-4c57-a8fc-3bd4d22c5e24\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm"
Sep 06 10:25:56.698477 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:56.698459    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5trt\" (UniqueName: \"kubernetes.io/projected/8179aedc-25b5-4c57-a8fc-3bd4d22c5e24-kube-api-access-t5trt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm\" (UID: \"8179aedc-25b5-4c57-a8fc-3bd4d22c5e24\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm"
Sep 06 10:25:56.797158 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:56.797087    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm"
Sep 06 10:25:57.064839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:57.064792    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm"]
Sep 06 10:25:57.067127 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:25:57.067103    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8179aedc_25b5_4c57_a8fc_3bd4d22c5e24.slice/crio-31b1f74d1572a7282a490f781cfeb0f4668c451163ec224ac55be46602025299 WatchSource:0}: Error finding container 31b1f74d1572a7282a490f781cfeb0f4668c451163ec224ac55be46602025299: Status 404 returned error can't find the container with id 31b1f74d1572a7282a490f781cfeb0f4668c451163ec224ac55be46602025299
Sep 06 10:25:57.118532 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:57.118506    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm" event={"ID":"8179aedc-25b5-4c57-a8fc-3bd4d22c5e24","Type":"ContainerStarted","Data":"31b1f74d1572a7282a490f781cfeb0f4668c451163ec224ac55be46602025299"}
Sep 06 10:25:58.125015 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:58.124914    2561 generic.go:356] "Generic (PLEG): container finished" podID="8179aedc-25b5-4c57-a8fc-3bd4d22c5e24" containerID="bbd7f6c1c4a01e0bddbc80aeae55ff83a0951191faa334b1fb32869d76656ec0" exitCode=0
Sep 06 10:25:58.125015 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:58.124982    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm" event={"ID":"8179aedc-25b5-4c57-a8fc-3bd4d22c5e24","Type":"ContainerDied","Data":"bbd7f6c1c4a01e0bddbc80aeae55ff83a0951191faa334b1fb32869d76656ec0"}
Sep 06 10:25:59.131547 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:59.131451    2561 generic.go:356] "Generic (PLEG): container finished" podID="8179aedc-25b5-4c57-a8fc-3bd4d22c5e24" containerID="7b7ce58c8a60b06b6094b786f3e7bff2e112614b048349e40161d82a9f42b39a" exitCode=0
Sep 06 10:25:59.131547 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:25:59.131530    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm" event={"ID":"8179aedc-25b5-4c57-a8fc-3bd4d22c5e24","Type":"ContainerDied","Data":"7b7ce58c8a60b06b6094b786f3e7bff2e112614b048349e40161d82a9f42b39a"}
Sep 06 10:26:00.023529 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.023491    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:00.100613 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.100579    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z"]
Sep 06 10:26:00.103902 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.103884    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z"
Sep 06 10:26:00.107394 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.107370    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 06 10:26:00.107739 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.107722    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 06 10:26:00.107951 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.107926    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 06 10:26:00.108035 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.108012    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rsrp9\""
Sep 06 10:26:00.108097 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.108071    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 06 10:26:00.108097 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.108081    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 06 10:26:00.127799 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.127775    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z"]
Sep 06 10:26:00.139031 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.139005    2561 generic.go:356] "Generic (PLEG): container finished" podID="8179aedc-25b5-4c57-a8fc-3bd4d22c5e24" containerID="00e693cf785d4907e4dbdb5a558fc6c3df0baf01494a937704e8af29e1585e6f" exitCode=0
Sep 06 10:26:00.139359 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.139082    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm" event={"ID":"8179aedc-25b5-4c57-a8fc-3bd4d22c5e24","Type":"ContainerDied","Data":"00e693cf785d4907e4dbdb5a558fc6c3df0baf01494a937704e8af29e1585e6f"}
Sep 06 10:26:00.173296 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.173264    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:00.220077 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.220045    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e-metrics-cert\") pod \"lws-controller-manager-5dc6f584c9-z859z\" (UID: \"1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e\") " pod="openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z"
Sep 06 10:26:00.220225 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.220129    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkfm6\" (UniqueName: \"kubernetes.io/projected/1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e-kube-api-access-xkfm6\") pod \"lws-controller-manager-5dc6f584c9-z859z\" (UID: \"1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e\") " pod="openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z"
Sep 06 10:26:00.220225 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.220159    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e-cert\") pod \"lws-controller-manager-5dc6f584c9-z859z\" (UID: \"1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e\") " pod="openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z"
Sep 06 10:26:00.220225 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.220183    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e-manager-config\") pod \"lws-controller-manager-5dc6f584c9-z859z\" (UID: \"1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e\") " pod="openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z"
Sep 06 10:26:00.321143 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.321071    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkfm6\" (UniqueName: \"kubernetes.io/projected/1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e-kube-api-access-xkfm6\") pod \"lws-controller-manager-5dc6f584c9-z859z\" (UID: \"1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e\") " pod="openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z"
Sep 06 10:26:00.321143 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.321108    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e-cert\") pod \"lws-controller-manager-5dc6f584c9-z859z\" (UID: \"1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e\") " pod="openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z"
Sep 06 10:26:00.321143 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.321132    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e-manager-config\") pod \"lws-controller-manager-5dc6f584c9-z859z\" (UID: \"1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e\") " pod="openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z"
Sep 06 10:26:00.321358 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.321193    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e-metrics-cert\") pod \"lws-controller-manager-5dc6f584c9-z859z\" (UID: \"1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e\") " pod="openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z"
Sep 06 10:26:00.321821 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.321790    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e-manager-config\") pod \"lws-controller-manager-5dc6f584c9-z859z\" (UID: \"1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e\") " pod="openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z"
Sep 06 10:26:00.323496 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.323473    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e-cert\") pod \"lws-controller-manager-5dc6f584c9-z859z\" (UID: \"1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e\") " pod="openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z"
Sep 06 10:26:00.323647 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.323629    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e-metrics-cert\") pod \"lws-controller-manager-5dc6f584c9-z859z\" (UID: \"1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e\") " pod="openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z"
Sep 06 10:26:00.331545 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.331521    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkfm6\" (UniqueName: \"kubernetes.io/projected/1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e-kube-api-access-xkfm6\") pod \"lws-controller-manager-5dc6f584c9-z859z\" (UID: \"1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e\") " pod="openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z"
Sep 06 10:26:00.413383 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.413312    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z"
Sep 06 10:26:00.704971 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:00.704914    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z"]
Sep 06 10:26:00.706987 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:26:00.706956    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d3c6039_9437_4ffe_bd6b_aec7d5d9c37e.slice/crio-75fce072211306077e4da32128cf7424faa446b7c05afc36f89a912d1336a28a WatchSource:0}: Error finding container 75fce072211306077e4da32128cf7424faa446b7c05afc36f89a912d1336a28a: Status 404 returned error can't find the container with id 75fce072211306077e4da32128cf7424faa446b7c05afc36f89a912d1336a28a
Sep 06 10:26:01.146619 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:01.146535    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z" event={"ID":"1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e","Type":"ContainerStarted","Data":"75fce072211306077e4da32128cf7424faa446b7c05afc36f89a912d1336a28a"}
Sep 06 10:26:01.256723 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:01.256699    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm"
Sep 06 10:26:01.329264 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:01.329234    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5trt\" (UniqueName: \"kubernetes.io/projected/8179aedc-25b5-4c57-a8fc-3bd4d22c5e24-kube-api-access-t5trt\") pod \"8179aedc-25b5-4c57-a8fc-3bd4d22c5e24\" (UID: \"8179aedc-25b5-4c57-a8fc-3bd4d22c5e24\") "
Sep 06 10:26:01.329442 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:01.329379    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8179aedc-25b5-4c57-a8fc-3bd4d22c5e24-util\") pod \"8179aedc-25b5-4c57-a8fc-3bd4d22c5e24\" (UID: \"8179aedc-25b5-4c57-a8fc-3bd4d22c5e24\") "
Sep 06 10:26:01.329511 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:01.329453    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8179aedc-25b5-4c57-a8fc-3bd4d22c5e24-bundle\") pod \"8179aedc-25b5-4c57-a8fc-3bd4d22c5e24\" (UID: \"8179aedc-25b5-4c57-a8fc-3bd4d22c5e24\") "
Sep 06 10:26:01.330450 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:01.330408    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8179aedc-25b5-4c57-a8fc-3bd4d22c5e24-bundle" (OuterVolumeSpecName: "bundle") pod "8179aedc-25b5-4c57-a8fc-3bd4d22c5e24" (UID: "8179aedc-25b5-4c57-a8fc-3bd4d22c5e24"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:26:01.331458 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:01.331436    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8179aedc-25b5-4c57-a8fc-3bd4d22c5e24-kube-api-access-t5trt" (OuterVolumeSpecName: "kube-api-access-t5trt") pod "8179aedc-25b5-4c57-a8fc-3bd4d22c5e24" (UID: "8179aedc-25b5-4c57-a8fc-3bd4d22c5e24"). InnerVolumeSpecName "kube-api-access-t5trt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:26:01.338211 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:01.338171    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8179aedc-25b5-4c57-a8fc-3bd4d22c5e24-util" (OuterVolumeSpecName: "util") pod "8179aedc-25b5-4c57-a8fc-3bd4d22c5e24" (UID: "8179aedc-25b5-4c57-a8fc-3bd4d22c5e24"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:26:01.430442 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:01.430414    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5trt\" (UniqueName: \"kubernetes.io/projected/8179aedc-25b5-4c57-a8fc-3bd4d22c5e24-kube-api-access-t5trt\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:26:01.430442 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:01.430440    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8179aedc-25b5-4c57-a8fc-3bd4d22c5e24-util\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:26:01.430602 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:01.430450    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8179aedc-25b5-4c57-a8fc-3bd4d22c5e24-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:26:02.156351 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:02.156289    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm" event={"ID":"8179aedc-25b5-4c57-a8fc-3bd4d22c5e24","Type":"ContainerDied","Data":"31b1f74d1572a7282a490f781cfeb0f4668c451163ec224ac55be46602025299"}
Sep 06 10:26:02.156811 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:02.156369    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="31b1f74d1572a7282a490f781cfeb0f4668c451163ec224ac55be46602025299"
Sep 06 10:26:02.156811 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:02.156302    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwg5jm"
Sep 06 10:26:03.162596 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:03.162558    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z" event={"ID":"1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e","Type":"ContainerStarted","Data":"a6dfbe5023273fdcf9feeac625b9af103bb67aceee88ddd6f8e2df646b1702ca"}
Sep 06 10:26:03.162956 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:03.162641    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z"
Sep 06 10:26:03.180812 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:03.180764    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z" podStartSLOduration=1.529384872 podStartE2EDuration="3.18074862s" totalImagesPullingTime="1.651363748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:26:03.179416187 +0000 UTC m=+254.957835601" watchObservedRunningTime="2026-09-06 10:26:03.18074862 +0000 UTC m=+254.959168032"
Sep 06 10:26:06.301338 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.301288    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2"]
Sep 06 10:26:06.301693 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.301618    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8179aedc-25b5-4c57-a8fc-3bd4d22c5e24" containerName="pull"
Sep 06 10:26:06.301693 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.301628    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8179aedc-25b5-4c57-a8fc-3bd4d22c5e24" containerName="pull"
Sep 06 10:26:06.301693 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.301637    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8179aedc-25b5-4c57-a8fc-3bd4d22c5e24" containerName="util"
Sep 06 10:26:06.301693 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.301642    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8179aedc-25b5-4c57-a8fc-3bd4d22c5e24" containerName="util"
Sep 06 10:26:06.301693 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.301658    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8179aedc-25b5-4c57-a8fc-3bd4d22c5e24" containerName="extract"
Sep 06 10:26:06.301693 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.301664    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8179aedc-25b5-4c57-a8fc-3bd4d22c5e24" containerName="extract"
Sep 06 10:26:06.301876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.301733    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8179aedc-25b5-4c57-a8fc-3bd4d22c5e24" containerName="extract"
Sep 06 10:26:06.307613 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.307594    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2"
Sep 06 10:26:06.309950 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.309928    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 06 10:26:06.310787 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.310762    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 06 10:26:06.310890 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.310773    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bc9cp\""
Sep 06 10:26:06.315700 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.315675    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2"]
Sep 06 10:26:06.374970 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.374930    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbd1e114-bd8c-4341-99a8-58e7b7e46bc0-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2\" (UID: \"bbd1e114-bd8c-4341-99a8-58e7b7e46bc0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2"
Sep 06 10:26:06.375161 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.374996    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjqsf\" (UniqueName: \"kubernetes.io/projected/bbd1e114-bd8c-4341-99a8-58e7b7e46bc0-kube-api-access-bjqsf\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2\" (UID: \"bbd1e114-bd8c-4341-99a8-58e7b7e46bc0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2"
Sep 06 10:26:06.375161 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.375097    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbd1e114-bd8c-4341-99a8-58e7b7e46bc0-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2\" (UID: \"bbd1e114-bd8c-4341-99a8-58e7b7e46bc0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2"
Sep 06 10:26:06.476270 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.476234    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjqsf\" (UniqueName: \"kubernetes.io/projected/bbd1e114-bd8c-4341-99a8-58e7b7e46bc0-kube-api-access-bjqsf\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2\" (UID: \"bbd1e114-bd8c-4341-99a8-58e7b7e46bc0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2"
Sep 06 10:26:06.476533 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.476301    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbd1e114-bd8c-4341-99a8-58e7b7e46bc0-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2\" (UID: \"bbd1e114-bd8c-4341-99a8-58e7b7e46bc0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2"
Sep 06 10:26:06.476533 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.476366    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbd1e114-bd8c-4341-99a8-58e7b7e46bc0-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2\" (UID: \"bbd1e114-bd8c-4341-99a8-58e7b7e46bc0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2"
Sep 06 10:26:06.476693 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.476677    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbd1e114-bd8c-4341-99a8-58e7b7e46bc0-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2\" (UID: \"bbd1e114-bd8c-4341-99a8-58e7b7e46bc0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2"
Sep 06 10:26:06.476750 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.476728    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbd1e114-bd8c-4341-99a8-58e7b7e46bc0-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2\" (UID: \"bbd1e114-bd8c-4341-99a8-58e7b7e46bc0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2"
Sep 06 10:26:06.484039 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.484015    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjqsf\" (UniqueName: \"kubernetes.io/projected/bbd1e114-bd8c-4341-99a8-58e7b7e46bc0-kube-api-access-bjqsf\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2\" (UID: \"bbd1e114-bd8c-4341-99a8-58e7b7e46bc0\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2"
Sep 06 10:26:06.617581 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.617498    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2"
Sep 06 10:26:06.890815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:06.890739    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2"]
Sep 06 10:26:06.893522 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:26:06.893488    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbd1e114_bd8c_4341_99a8_58e7b7e46bc0.slice/crio-097e7eb390b839eab4f01e4aae7dc6ba4985036805033a1336e59887c6bf750e WatchSource:0}: Error finding container 097e7eb390b839eab4f01e4aae7dc6ba4985036805033a1336e59887c6bf750e: Status 404 returned error can't find the container with id 097e7eb390b839eab4f01e4aae7dc6ba4985036805033a1336e59887c6bf750e
Sep 06 10:26:07.183911 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:07.183876    2561 generic.go:356] "Generic (PLEG): container finished" podID="bbd1e114-bd8c-4341-99a8-58e7b7e46bc0" containerID="7aa8c322b80ce15e1c62254c86cb33adbb6a209ea49768f9090c6336f1cd2159" exitCode=0
Sep 06 10:26:07.184049 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:07.183961    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2" event={"ID":"bbd1e114-bd8c-4341-99a8-58e7b7e46bc0","Type":"ContainerDied","Data":"7aa8c322b80ce15e1c62254c86cb33adbb6a209ea49768f9090c6336f1cd2159"}
Sep 06 10:26:07.184049 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:07.184015    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2" event={"ID":"bbd1e114-bd8c-4341-99a8-58e7b7e46bc0","Type":"ContainerStarted","Data":"097e7eb390b839eab4f01e4aae7dc6ba4985036805033a1336e59887c6bf750e"}
Sep 06 10:26:07.381953 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:07.381925    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:07.482610 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:07.482536    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:08.018562 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.018533    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:08.190885 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.190856    2561 generic.go:356] "Generic (PLEG): container finished" podID="bbd1e114-bd8c-4341-99a8-58e7b7e46bc0" containerID="5f824eed549cb4d162998fba2272ad226fb112385059521aca59e38cc8faf361" exitCode=0
Sep 06 10:26:08.191057 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.190917    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2" event={"ID":"bbd1e114-bd8c-4341-99a8-58e7b7e46bc0","Type":"ContainerDied","Data":"5f824eed549cb4d162998fba2272ad226fb112385059521aca59e38cc8faf361"}
Sep 06 10:26:08.327433 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.327398    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:08.427509 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.427458    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:08.470621 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.470549    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"]
Sep 06 10:26:08.473836 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.473820    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"
Sep 06 10:26:08.476367 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.476343    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 06 10:26:08.476492 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.476411    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 06 10:26:08.476492 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.476442    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 06 10:26:08.476618 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.476494    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 06 10:26:08.476733 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.476716    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-w5pz8\""
Sep 06 10:26:08.490821 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.490775    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"]
Sep 06 10:26:08.594067 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.594037    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/18ff4b44-2447-4508-baca-b7558d62b48e-webhook-cert\") pod \"opendatahub-operator-controller-manager-c688cbfb6-x8v4w\" (UID: \"18ff4b44-2447-4508-baca-b7558d62b48e\") " pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"
Sep 06 10:26:08.594240 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.594075    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc6xz\" (UniqueName: \"kubernetes.io/projected/18ff4b44-2447-4508-baca-b7558d62b48e-kube-api-access-fc6xz\") pod \"opendatahub-operator-controller-manager-c688cbfb6-x8v4w\" (UID: \"18ff4b44-2447-4508-baca-b7558d62b48e\") " pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"
Sep 06 10:26:08.594240 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.594096    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/18ff4b44-2447-4508-baca-b7558d62b48e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c688cbfb6-x8v4w\" (UID: \"18ff4b44-2447-4508-baca-b7558d62b48e\") " pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"
Sep 06 10:26:08.594240 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.594116    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18ff4b44-2447-4508-baca-b7558d62b48e-tmp\") pod \"opendatahub-operator-controller-manager-c688cbfb6-x8v4w\" (UID: \"18ff4b44-2447-4508-baca-b7558d62b48e\") " pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"
Sep 06 10:26:08.594240 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.594182    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/18ff4b44-2447-4508-baca-b7558d62b48e-manifests\") pod \"opendatahub-operator-controller-manager-c688cbfb6-x8v4w\" (UID: \"18ff4b44-2447-4508-baca-b7558d62b48e\") " pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"
Sep 06 10:26:08.665510 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.665475    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:08.694670 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.694642    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/18ff4b44-2447-4508-baca-b7558d62b48e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c688cbfb6-x8v4w\" (UID: \"18ff4b44-2447-4508-baca-b7558d62b48e\") " pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"
Sep 06 10:26:08.694760 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.694680    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18ff4b44-2447-4508-baca-b7558d62b48e-tmp\") pod \"opendatahub-operator-controller-manager-c688cbfb6-x8v4w\" (UID: \"18ff4b44-2447-4508-baca-b7558d62b48e\") " pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"
Sep 06 10:26:08.694760 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.694698    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/18ff4b44-2447-4508-baca-b7558d62b48e-manifests\") pod \"opendatahub-operator-controller-manager-c688cbfb6-x8v4w\" (UID: \"18ff4b44-2447-4508-baca-b7558d62b48e\") " pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"
Sep 06 10:26:08.694857 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.694769    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/18ff4b44-2447-4508-baca-b7558d62b48e-webhook-cert\") pod \"opendatahub-operator-controller-manager-c688cbfb6-x8v4w\" (UID: \"18ff4b44-2447-4508-baca-b7558d62b48e\") " pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"
Sep 06 10:26:08.694857 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.694791    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6xz\" (UniqueName: \"kubernetes.io/projected/18ff4b44-2447-4508-baca-b7558d62b48e-kube-api-access-fc6xz\") pod \"opendatahub-operator-controller-manager-c688cbfb6-x8v4w\" (UID: \"18ff4b44-2447-4508-baca-b7558d62b48e\") " pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"
Sep 06 10:26:08.695221 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.695199    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/18ff4b44-2447-4508-baca-b7558d62b48e-manifests\") pod \"opendatahub-operator-controller-manager-c688cbfb6-x8v4w\" (UID: \"18ff4b44-2447-4508-baca-b7558d62b48e\") " pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"
Sep 06 10:26:08.697096 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.697070    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18ff4b44-2447-4508-baca-b7558d62b48e-tmp\") pod \"opendatahub-operator-controller-manager-c688cbfb6-x8v4w\" (UID: \"18ff4b44-2447-4508-baca-b7558d62b48e\") " pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"
Sep 06 10:26:08.697195 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.697179    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/18ff4b44-2447-4508-baca-b7558d62b48e-webhook-cert\") pod \"opendatahub-operator-controller-manager-c688cbfb6-x8v4w\" (UID: \"18ff4b44-2447-4508-baca-b7558d62b48e\") " pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"
Sep 06 10:26:08.697300 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.697283    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/18ff4b44-2447-4508-baca-b7558d62b48e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c688cbfb6-x8v4w\" (UID: \"18ff4b44-2447-4508-baca-b7558d62b48e\") " pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"
Sep 06 10:26:08.702003 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.701981    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc6xz\" (UniqueName: \"kubernetes.io/projected/18ff4b44-2447-4508-baca-b7558d62b48e-kube-api-access-fc6xz\") pod \"opendatahub-operator-controller-manager-c688cbfb6-x8v4w\" (UID: \"18ff4b44-2447-4508-baca-b7558d62b48e\") " pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"
Sep 06 10:26:08.763330 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.763237    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:08.783775 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.783757    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"
Sep 06 10:26:08.864061 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.864029    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:08.965876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:08.965841    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:09.041729 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:09.041652    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:09.058631 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:09.058606    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"]
Sep 06 10:26:09.060936 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:26:09.060907    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ff4b44_2447_4508_baca_b7558d62b48e.slice/crio-b6075ec8c6e54f70f50769921712d54fc9750f7f932edc9b38944b2ad1ce3ed8 WatchSource:0}: Error finding container b6075ec8c6e54f70f50769921712d54fc9750f7f932edc9b38944b2ad1ce3ed8: Status 404 returned error can't find the container with id b6075ec8c6e54f70f50769921712d54fc9750f7f932edc9b38944b2ad1ce3ed8
Sep 06 10:26:09.104638 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:09.104602    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:09.198382 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:09.198345    2561 generic.go:356] "Generic (PLEG): container finished" podID="bbd1e114-bd8c-4341-99a8-58e7b7e46bc0" containerID="67bff328ee5a6453ee11e6807abdd841be2f557e3e2c89b8962d94fd1ebfb52e" exitCode=0
Sep 06 10:26:09.198538 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:09.198422    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2" event={"ID":"bbd1e114-bd8c-4341-99a8-58e7b7e46bc0","Type":"ContainerDied","Data":"67bff328ee5a6453ee11e6807abdd841be2f557e3e2c89b8962d94fd1ebfb52e"}
Sep 06 10:26:09.199720 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:09.199698    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w" event={"ID":"18ff4b44-2447-4508-baca-b7558d62b48e","Type":"ContainerStarted","Data":"b6075ec8c6e54f70f50769921712d54fc9750f7f932edc9b38944b2ad1ce3ed8"}
Sep 06 10:26:09.205999 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:09.205980    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:10.372262 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:10.372227    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2"
Sep 06 10:26:10.512764 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:10.512667    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbd1e114-bd8c-4341-99a8-58e7b7e46bc0-util\") pod \"bbd1e114-bd8c-4341-99a8-58e7b7e46bc0\" (UID: \"bbd1e114-bd8c-4341-99a8-58e7b7e46bc0\") "
Sep 06 10:26:10.512764 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:10.512752    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbd1e114-bd8c-4341-99a8-58e7b7e46bc0-bundle\") pod \"bbd1e114-bd8c-4341-99a8-58e7b7e46bc0\" (UID: \"bbd1e114-bd8c-4341-99a8-58e7b7e46bc0\") "
Sep 06 10:26:10.513091 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:10.512794    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjqsf\" (UniqueName: \"kubernetes.io/projected/bbd1e114-bd8c-4341-99a8-58e7b7e46bc0-kube-api-access-bjqsf\") pod \"bbd1e114-bd8c-4341-99a8-58e7b7e46bc0\" (UID: \"bbd1e114-bd8c-4341-99a8-58e7b7e46bc0\") "
Sep 06 10:26:10.516743 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:10.516707    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbd1e114-bd8c-4341-99a8-58e7b7e46bc0-bundle" (OuterVolumeSpecName: "bundle") pod "bbd1e114-bd8c-4341-99a8-58e7b7e46bc0" (UID: "bbd1e114-bd8c-4341-99a8-58e7b7e46bc0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:26:10.518562 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:10.518515    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbd1e114-bd8c-4341-99a8-58e7b7e46bc0-kube-api-access-bjqsf" (OuterVolumeSpecName: "kube-api-access-bjqsf") pod "bbd1e114-bd8c-4341-99a8-58e7b7e46bc0" (UID: "bbd1e114-bd8c-4341-99a8-58e7b7e46bc0"). InnerVolumeSpecName "kube-api-access-bjqsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:26:10.522463 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:10.522432    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbd1e114-bd8c-4341-99a8-58e7b7e46bc0-util" (OuterVolumeSpecName: "util") pod "bbd1e114-bd8c-4341-99a8-58e7b7e46bc0" (UID: "bbd1e114-bd8c-4341-99a8-58e7b7e46bc0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:26:10.614387 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:10.614351    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbd1e114-bd8c-4341-99a8-58e7b7e46bc0-util\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:26:10.614387 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:10.614385    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbd1e114-bd8c-4341-99a8-58e7b7e46bc0-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:26:10.614628 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:10.614399    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjqsf\" (UniqueName: \"kubernetes.io/projected/bbd1e114-bd8c-4341-99a8-58e7b7e46bc0-kube-api-access-bjqsf\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:26:11.215918 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:11.215807    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2" event={"ID":"bbd1e114-bd8c-4341-99a8-58e7b7e46bc0","Type":"ContainerDied","Data":"097e7eb390b839eab4f01e4aae7dc6ba4985036805033a1336e59887c6bf750e"}
Sep 06 10:26:11.215918 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:11.215879    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="097e7eb390b839eab4f01e4aae7dc6ba4985036805033a1336e59887c6bf750e"
Sep 06 10:26:11.215918 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:11.215885    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0kmfs2"
Sep 06 10:26:12.222068 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:12.222029    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w" event={"ID":"18ff4b44-2447-4508-baca-b7558d62b48e","Type":"ContainerStarted","Data":"8d68f8c0ab89acfdaa5e5a9dfba3721bd8690c28cbf3cbb8964341c4d31bdf0e"}
Sep 06 10:26:13.228887 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:13.228851    2561 generic.go:356] "Generic (PLEG): container finished" podID="18ff4b44-2447-4508-baca-b7558d62b48e" containerID="8d68f8c0ab89acfdaa5e5a9dfba3721bd8690c28cbf3cbb8964341c4d31bdf0e" exitCode=0
Sep 06 10:26:13.229260 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:13.228911    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w" event={"ID":"18ff4b44-2447-4508-baca-b7558d62b48e","Type":"ContainerDied","Data":"8d68f8c0ab89acfdaa5e5a9dfba3721bd8690c28cbf3cbb8964341c4d31bdf0e"}
Sep 06 10:26:14.170139 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:14.170105    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5dc6f584c9-z859z"
Sep 06 10:26:14.236064 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:14.236027    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w" event={"ID":"18ff4b44-2447-4508-baca-b7558d62b48e","Type":"ContainerStarted","Data":"7288e921e642d40dd5f7bd1c1f9c40c90eb092726a958ce760fa879545a3755f"}
Sep 06 10:26:14.236486 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:14.236152    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"
Sep 06 10:26:14.255266 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:14.255214    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w" podStartSLOduration=1.959702052 podStartE2EDuration="6.255192384s" totalImagesPullingTime="3.201636041s" totalInitContainerRuntime="1.093854291s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:26:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:26:14.254824619 +0000 UTC m=+266.033244043" watchObservedRunningTime="2026-09-06 10:26:14.255192384 +0000 UTC m=+266.033611798"
Sep 06 10:26:25.243200 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:25.243167    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c688cbfb6-x8v4w"
Sep 06 10:26:27.100873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:27.100839    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:27.207711 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:27.207674    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:27.475967 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:27.475935    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:27.709089 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:27.709051    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:28.854078 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:28.854047    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:28.963490 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:28.963455    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:29.815990 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:29.815955    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:33.374957 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.374920    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:33.434876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.434849    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:33.633842 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.633768    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"]
Sep 06 10:26:33.634104 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.634091    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd1e114-bd8c-4341-99a8-58e7b7e46bc0" containerName="pull"
Sep 06 10:26:33.634150 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.634106    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd1e114-bd8c-4341-99a8-58e7b7e46bc0" containerName="pull"
Sep 06 10:26:33.634150 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.634123    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd1e114-bd8c-4341-99a8-58e7b7e46bc0" containerName="util"
Sep 06 10:26:33.634150 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.634129    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd1e114-bd8c-4341-99a8-58e7b7e46bc0" containerName="util"
Sep 06 10:26:33.634150 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.634135    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd1e114-bd8c-4341-99a8-58e7b7e46bc0" containerName="extract"
Sep 06 10:26:33.634150 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.634141    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd1e114-bd8c-4341-99a8-58e7b7e46bc0" containerName="extract"
Sep 06 10:26:33.634297 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.634202    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbd1e114-bd8c-4341-99a8-58e7b7e46bc0" containerName="extract"
Sep 06 10:26:33.642269 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.642245    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.644802 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.644777    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 06 10:26:33.644910 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.644799    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hrsrb\""
Sep 06 10:26:33.652863 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.652835    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"]
Sep 06 10:26:33.672573 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.672544    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:33.710950 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.710918    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.711118 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.710975    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.711118 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.711045    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.711118 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.711097    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.711245 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.711132    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.711245 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.711154    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.711245 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.711170    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.711245 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.711186    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkh9w\" (UniqueName: \"kubernetes.io/projected/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-kube-api-access-qkh9w\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.711452 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.711257    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.744941 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.744907    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"]
Sep 06 10:26:33.748539 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.748515    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.760865 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.760842    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"]
Sep 06 10:26:33.806382 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.806347    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:33.812620 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.812600    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.812732 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.812633    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b57be4b3-f641-48d6-990d-302fe3fe9c0f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.812732 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.812657    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b57be4b3-f641-48d6-990d-302fe3fe9c0f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.812732 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.812703    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.812732 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.812723    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.812947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.812751    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b57be4b3-f641-48d6-990d-302fe3fe9c0f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.812947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.812781    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.812947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.812813    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.812947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.812839    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.812947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.812866    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkh9w\" (UniqueName: \"kubernetes.io/projected/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-kube-api-access-qkh9w\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.812947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.812891    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.812947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.812913    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b57be4b3-f641-48d6-990d-302fe3fe9c0f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.813315 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.812963    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b57be4b3-f641-48d6-990d-302fe3fe9c0f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.813315 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.812995    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b57be4b3-f641-48d6-990d-302fe3fe9c0f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.813315 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.813056    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkcn6\" (UniqueName: \"kubernetes.io/projected/b57be4b3-f641-48d6-990d-302fe3fe9c0f-kube-api-access-mkcn6\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.813315 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.813086    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.813315 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.813165    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.813315 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.813170    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b57be4b3-f641-48d6-990d-302fe3fe9c0f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.813315 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.813221    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.813315 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.813269    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.813783 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.813368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b57be4b3-f641-48d6-990d-302fe3fe9c0f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.813783 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.813595    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.813783 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.813680    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.815166 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.815144    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.815431 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.815415    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.821959 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.821930    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkh9w\" (UniqueName: \"kubernetes.io/projected/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-kube-api-access-qkh9w\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.822067 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.822002    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bckvt9f\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:33.913777 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.913747    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkcn6\" (UniqueName: \"kubernetes.io/projected/b57be4b3-f641-48d6-990d-302fe3fe9c0f-kube-api-access-mkcn6\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.913940 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.913801    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b57be4b3-f641-48d6-990d-302fe3fe9c0f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.913940 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.913826    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b57be4b3-f641-48d6-990d-302fe3fe9c0f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.913940 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.913849    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b57be4b3-f641-48d6-990d-302fe3fe9c0f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.913940 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.913872    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b57be4b3-f641-48d6-990d-302fe3fe9c0f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.913940 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.913908    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b57be4b3-f641-48d6-990d-302fe3fe9c0f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.914205 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.913985    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b57be4b3-f641-48d6-990d-302fe3fe9c0f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.914205 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.914049    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b57be4b3-f641-48d6-990d-302fe3fe9c0f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.914205 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.914079    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b57be4b3-f641-48d6-990d-302fe3fe9c0f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.914403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.914294    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b57be4b3-f641-48d6-990d-302fe3fe9c0f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.914403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.914372    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b57be4b3-f641-48d6-990d-302fe3fe9c0f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.914504 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.914422    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b57be4b3-f641-48d6-990d-302fe3fe9c0f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.914597 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.914572    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b57be4b3-f641-48d6-990d-302fe3fe9c0f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.914744 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.914726    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b57be4b3-f641-48d6-990d-302fe3fe9c0f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.916276 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.916248    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b57be4b3-f641-48d6-990d-302fe3fe9c0f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.916442 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.916426    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b57be4b3-f641-48d6-990d-302fe3fe9c0f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.921460 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.921435    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkcn6\" (UniqueName: \"kubernetes.io/projected/b57be4b3-f641-48d6-990d-302fe3fe9c0f-kube-api-access-mkcn6\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.921543 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.921441    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b57be4b3-f641-48d6-990d-302fe3fe9c0f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd\" (UID: \"b57be4b3-f641-48d6-990d-302fe3fe9c0f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:33.954570 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:33.954546    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:34.018780 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:34.018718    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:34.059365 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:34.059317    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:34.227641 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:34.227551    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"]
Sep 06 10:26:34.229873 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:26:34.229848    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod144bb23b_5c6e_403e_a1e2_b227fe4c00c2.slice/crio-3d02c7a512efad092b71f52d2b62cd3834bc9c63e2a71576ff365039eec77dff WatchSource:0}: Error finding container 3d02c7a512efad092b71f52d2b62cd3834bc9c63e2a71576ff365039eec77dff: Status 404 returned error can't find the container with id 3d02c7a512efad092b71f52d2b62cd3834bc9c63e2a71576ff365039eec77dff
Sep 06 10:26:34.329429 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:34.329406    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"]
Sep 06 10:26:34.331364 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:26:34.331339    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb57be4b3_f641_48d6_990d_302fe3fe9c0f.slice/crio-6721fe553b3f534c8903dd9a4fe3b93c4601cf70a9dd616d46a641868def9bba WatchSource:0}: Error finding container 6721fe553b3f534c8903dd9a4fe3b93c4601cf70a9dd616d46a641868def9bba: Status 404 returned error can't find the container with id 6721fe553b3f534c8903dd9a4fe3b93c4601cf70a9dd616d46a641868def9bba
Sep 06 10:26:34.338835 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:34.338810    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f" event={"ID":"144bb23b-5c6e-403e-a1e2-b227fe4c00c2","Type":"ContainerStarted","Data":"3d02c7a512efad092b71f52d2b62cd3834bc9c63e2a71576ff365039eec77dff"}
Sep 06 10:26:34.340078 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:34.340057    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd" event={"ID":"b57be4b3-f641-48d6-990d-302fe3fe9c0f","Type":"ContainerStarted","Data":"6721fe553b3f534c8903dd9a4fe3b93c4601cf70a9dd616d46a641868def9bba"}
Sep 06 10:26:37.222437 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:37.222388    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:26:37.222727 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:37.222475    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:26:37.222727 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:37.222508    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:26:37.228123 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:37.228089    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:26:37.228214 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:37.228153    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:26:37.228214 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:37.228184    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:26:37.362794 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:37.361874    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd" event={"ID":"b57be4b3-f641-48d6-990d-302fe3fe9c0f","Type":"ContainerStarted","Data":"f27570b07bccbb090f984c17a4284ac3314bfc9e2c4d0a55d6bc34f2c94d6122"}
Sep 06 10:26:37.364684 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:37.364654    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f" event={"ID":"144bb23b-5c6e-403e-a1e2-b227fe4c00c2","Type":"ContainerStarted","Data":"77e51cd5276a0b5f3763b648019a7776257b96c2d68c66240c4506714ed59e2a"}
Sep 06 10:26:37.384992 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:37.384933    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd" podStartSLOduration=1.490561736 podStartE2EDuration="4.38491498s" totalImagesPullingTime="2.894353244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:26:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:26:37.382846506 +0000 UTC m=+289.161265920" watchObservedRunningTime="2026-09-06 10:26:37.38491498 +0000 UTC m=+289.163334392"
Sep 06 10:26:37.402201 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:37.402138    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f" podStartSLOduration=1.412088595 podStartE2EDuration="4.402118457s" totalImagesPullingTime="2.990029862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:26:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:26:37.401566941 +0000 UTC m=+289.179986358" watchObservedRunningTime="2026-09-06 10:26:37.402118457 +0000 UTC m=+289.180537871"
Sep 06 10:26:37.954891 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:37.954856    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:38.060403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:38.060369    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:38.065286 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:38.065258    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:38.237664 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:38.237584    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:38.293790 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:38.293743    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:38.370143 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:38.370108    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:38.371221 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:38.371200    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd"
Sep 06 10:26:38.400689 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:38.400647    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:38.422461 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:38.422434    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"]
Sep 06 10:26:38.499074 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:38.498983    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:38.749555 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:38.749470    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:38.956666 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:38.956628    2561 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 06 10:26:38.956837 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:38.956698    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f" podUID="144bb23b-5c6e-403e-a1e2-b227fe4c00c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 06 10:26:39.097115 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:39.097021    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:39.955708 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:39.955664    2561 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Sep 06 10:26:39.956094 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:39.955738    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f" podUID="144bb23b-5c6e-403e-a1e2-b227fe4c00c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Sep 06 10:26:40.379233 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:40.379134    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f" podUID="144bb23b-5c6e-403e-a1e2-b227fe4c00c2" containerName="istio-proxy" containerID="cri-o://77e51cd5276a0b5f3763b648019a7776257b96c2d68c66240c4506714ed59e2a" gracePeriod=30
Sep 06 10:26:45.635698 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.635673    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:45.721370 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.721338    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-podinfo\") pod \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") "
Sep 06 10:26:45.721547 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.721376    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istiod-ca-cert\") pod \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") "
Sep 06 10:26:45.721547 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.721423    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkh9w\" (UniqueName: \"kubernetes.io/projected/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-kube-api-access-qkh9w\") pod \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") "
Sep 06 10:26:45.721547 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.721459    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-data\") pod \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") "
Sep 06 10:26:45.721547 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.721477    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-credential-socket\") pod \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") "
Sep 06 10:26:45.721547 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.721498    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-token\") pod \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") "
Sep 06 10:26:45.721815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.721597    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-workload-socket\") pod \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") "
Sep 06 10:26:45.721815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.721699    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-workload-certs\") pod \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") "
Sep 06 10:26:45.721815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.721724    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-envoy\") pod \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\" (UID: \"144bb23b-5c6e-403e-a1e2-b227fe4c00c2\") "
Sep 06 10:26:45.722027 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.721815    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "144bb23b-5c6e-403e-a1e2-b227fe4c00c2" (UID: "144bb23b-5c6e-403e-a1e2-b227fe4c00c2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:26:45.722027 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.721843    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "144bb23b-5c6e-403e-a1e2-b227fe4c00c2" (UID: "144bb23b-5c6e-403e-a1e2-b227fe4c00c2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:26:45.722027 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.721817    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-data" (OuterVolumeSpecName: "istio-data") pod "144bb23b-5c6e-403e-a1e2-b227fe4c00c2" (UID: "144bb23b-5c6e-403e-a1e2-b227fe4c00c2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:26:45.722027 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.721884    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "144bb23b-5c6e-403e-a1e2-b227fe4c00c2" (UID: "144bb23b-5c6e-403e-a1e2-b227fe4c00c2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:26:45.722220 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.722001    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:26:45.722220 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.722059    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:26:45.722220 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.722071    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:26:45.722220 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.722085    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:26:45.722220 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.722086    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "144bb23b-5c6e-403e-a1e2-b227fe4c00c2" (UID: "144bb23b-5c6e-403e-a1e2-b227fe4c00c2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:26:45.724090 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.724057    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-token" (OuterVolumeSpecName: "istio-token") pod "144bb23b-5c6e-403e-a1e2-b227fe4c00c2" (UID: "144bb23b-5c6e-403e-a1e2-b227fe4c00c2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:26:45.724090 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.724058    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-kube-api-access-qkh9w" (OuterVolumeSpecName: "kube-api-access-qkh9w") pod "144bb23b-5c6e-403e-a1e2-b227fe4c00c2" (UID: "144bb23b-5c6e-403e-a1e2-b227fe4c00c2"). InnerVolumeSpecName "kube-api-access-qkh9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:26:45.724231 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.724130    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "144bb23b-5c6e-403e-a1e2-b227fe4c00c2" (UID: "144bb23b-5c6e-403e-a1e2-b227fe4c00c2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 10:26:45.724231 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.724140    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "144bb23b-5c6e-403e-a1e2-b227fe4c00c2" (UID: "144bb23b-5c6e-403e-a1e2-b227fe4c00c2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:26:45.822721 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.822682    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:26:45.822721 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.822716    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:26:45.822721 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.822725    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:26:45.822947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.822733    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkh9w\" (UniqueName: \"kubernetes.io/projected/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-kube-api-access-qkh9w\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:26:45.822947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:45.822745    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/144bb23b-5c6e-403e-a1e2-b227fe4c00c2-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:26:46.411386 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:46.411343    2561 generic.go:356] "Generic (PLEG): container finished" podID="144bb23b-5c6e-403e-a1e2-b227fe4c00c2" containerID="77e51cd5276a0b5f3763b648019a7776257b96c2d68c66240c4506714ed59e2a" exitCode=0
Sep 06 10:26:46.411386 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:46.411380    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"
Sep 06 10:26:46.411618 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:46.411417    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f" event={"ID":"144bb23b-5c6e-403e-a1e2-b227fe4c00c2","Type":"ContainerDied","Data":"77e51cd5276a0b5f3763b648019a7776257b96c2d68c66240c4506714ed59e2a"}
Sep 06 10:26:46.411618 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:46.411475    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f" event={"ID":"144bb23b-5c6e-403e-a1e2-b227fe4c00c2","Type":"ContainerDied","Data":"3d02c7a512efad092b71f52d2b62cd3834bc9c63e2a71576ff365039eec77dff"}
Sep 06 10:26:46.411618 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:46.411498    2561 scope.go:117] "RemoveContainer" containerID="77e51cd5276a0b5f3763b648019a7776257b96c2d68c66240c4506714ed59e2a"
Sep 06 10:26:46.423204 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:46.423184    2561 scope.go:117] "RemoveContainer" containerID="77e51cd5276a0b5f3763b648019a7776257b96c2d68c66240c4506714ed59e2a"
Sep 06 10:26:46.423527 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:26:46.423505    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77e51cd5276a0b5f3763b648019a7776257b96c2d68c66240c4506714ed59e2a\": container with ID starting with 77e51cd5276a0b5f3763b648019a7776257b96c2d68c66240c4506714ed59e2a not found: ID does not exist" containerID="77e51cd5276a0b5f3763b648019a7776257b96c2d68c66240c4506714ed59e2a"
Sep 06 10:26:46.423604 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:46.423539    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77e51cd5276a0b5f3763b648019a7776257b96c2d68c66240c4506714ed59e2a"} err="failed to get container status \"77e51cd5276a0b5f3763b648019a7776257b96c2d68c66240c4506714ed59e2a\": rpc error: code = NotFound desc = could not find container \"77e51cd5276a0b5f3763b648019a7776257b96c2d68c66240c4506714ed59e2a\": container with ID starting with 77e51cd5276a0b5f3763b648019a7776257b96c2d68c66240c4506714ed59e2a not found: ID does not exist"
Sep 06 10:26:46.450717 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:46.450687    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"]
Sep 06 10:26:46.465715 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:46.465685    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bckvt9f"]
Sep 06 10:26:46.760466 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:46.760387    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="144bb23b-5c6e-403e-a1e2-b227fe4c00c2" path="/var/lib/kubelet/pods/144bb23b-5c6e-403e-a1e2-b227fe4c00c2/volumes"
Sep 06 10:26:47.354008 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.353973    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:47.421639 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.421605    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7scd5"]
Sep 06 10:26:47.422022 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.422004    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="144bb23b-5c6e-403e-a1e2-b227fe4c00c2" containerName="istio-proxy"
Sep 06 10:26:47.422167 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.422024    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="144bb23b-5c6e-403e-a1e2-b227fe4c00c2" containerName="istio-proxy"
Sep 06 10:26:47.422167 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.422134    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="144bb23b-5c6e-403e-a1e2-b227fe4c00c2" containerName="istio-proxy"
Sep 06 10:26:47.425962 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.425939    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7scd5"
Sep 06 10:26:47.429216 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.429194    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 06 10:26:47.429336 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.429229    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-kgfcv\""
Sep 06 10:26:47.436100 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.436076    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7scd5"]
Sep 06 10:26:47.438240 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.438218    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jtfgl"]
Sep 06 10:26:47.441411 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.441392    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jtfgl"
Sep 06 10:26:47.443804 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.443781    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-b2wvk\""
Sep 06 10:26:47.444355 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.444286    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 06 10:26:47.451685 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.451660    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jtfgl"]
Sep 06 10:26:47.452792 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.452768    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:47.535720 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.535686    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d6d17cc-95fa-4644-90f2-79dfda62db96-cert\") pod \"kserve-controller-manager-d6f4b65b8-7scd5\" (UID: \"3d6d17cc-95fa-4644-90f2-79dfda62db96\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7scd5"
Sep 06 10:26:47.535720 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.535724    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pg6d\" (UniqueName: \"kubernetes.io/projected/3d6d17cc-95fa-4644-90f2-79dfda62db96-kube-api-access-9pg6d\") pod \"kserve-controller-manager-d6f4b65b8-7scd5\" (UID: \"3d6d17cc-95fa-4644-90f2-79dfda62db96\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7scd5"
Sep 06 10:26:47.535955 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.535836    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/754d046c-c778-49e0-b609-1f11e839568c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jtfgl\" (UID: \"754d046c-c778-49e0-b609-1f11e839568c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jtfgl"
Sep 06 10:26:47.535955 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.535888    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twzrf\" (UniqueName: \"kubernetes.io/projected/754d046c-c778-49e0-b609-1f11e839568c-kube-api-access-twzrf\") pod \"llmisvc-controller-manager-777c6bd7d5-jtfgl\" (UID: \"754d046c-c778-49e0-b609-1f11e839568c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jtfgl"
Sep 06 10:26:47.580860 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.580827    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:47.637406 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.637283    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twzrf\" (UniqueName: \"kubernetes.io/projected/754d046c-c778-49e0-b609-1f11e839568c-kube-api-access-twzrf\") pod \"llmisvc-controller-manager-777c6bd7d5-jtfgl\" (UID: \"754d046c-c778-49e0-b609-1f11e839568c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jtfgl"
Sep 06 10:26:47.637406 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.637392    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d6d17cc-95fa-4644-90f2-79dfda62db96-cert\") pod \"kserve-controller-manager-d6f4b65b8-7scd5\" (UID: \"3d6d17cc-95fa-4644-90f2-79dfda62db96\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7scd5"
Sep 06 10:26:47.637633 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.637428    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pg6d\" (UniqueName: \"kubernetes.io/projected/3d6d17cc-95fa-4644-90f2-79dfda62db96-kube-api-access-9pg6d\") pod \"kserve-controller-manager-d6f4b65b8-7scd5\" (UID: \"3d6d17cc-95fa-4644-90f2-79dfda62db96\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7scd5"
Sep 06 10:26:47.637633 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.637501    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/754d046c-c778-49e0-b609-1f11e839568c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jtfgl\" (UID: \"754d046c-c778-49e0-b609-1f11e839568c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jtfgl"
Sep 06 10:26:47.639839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.639808    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d6d17cc-95fa-4644-90f2-79dfda62db96-cert\") pod \"kserve-controller-manager-d6f4b65b8-7scd5\" (UID: \"3d6d17cc-95fa-4644-90f2-79dfda62db96\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7scd5"
Sep 06 10:26:47.639981 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.639959    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/754d046c-c778-49e0-b609-1f11e839568c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jtfgl\" (UID: \"754d046c-c778-49e0-b609-1f11e839568c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jtfgl"
Sep 06 10:26:47.649991 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.649968    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twzrf\" (UniqueName: \"kubernetes.io/projected/754d046c-c778-49e0-b609-1f11e839568c-kube-api-access-twzrf\") pod \"llmisvc-controller-manager-777c6bd7d5-jtfgl\" (UID: \"754d046c-c778-49e0-b609-1f11e839568c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jtfgl"
Sep 06 10:26:47.651275 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.651254    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pg6d\" (UniqueName: \"kubernetes.io/projected/3d6d17cc-95fa-4644-90f2-79dfda62db96-kube-api-access-9pg6d\") pod \"kserve-controller-manager-d6f4b65b8-7scd5\" (UID: \"3d6d17cc-95fa-4644-90f2-79dfda62db96\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7scd5"
Sep 06 10:26:47.707415 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.707372    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:47.736877 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.736843    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7scd5"
Sep 06 10:26:47.754431 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:47.754409    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jtfgl"
Sep 06 10:26:48.015366 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:48.015339    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7scd5"]
Sep 06 10:26:48.016731 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:26:48.016697    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6d17cc_95fa_4644_90f2_79dfda62db96.slice/crio-0fb5b161ecbcd081afcff0f85e3eacd3e008ad549c2641d647a9d520c364c688 WatchSource:0}: Error finding container 0fb5b161ecbcd081afcff0f85e3eacd3e008ad549c2641d647a9d520c364c688: Status 404 returned error can't find the container with id 0fb5b161ecbcd081afcff0f85e3eacd3e008ad549c2641d647a9d520c364c688
Sep 06 10:26:48.040867 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:48.040840    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jtfgl"]
Sep 06 10:26:48.041462 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:26:48.041439    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod754d046c_c778_49e0_b609_1f11e839568c.slice/crio-e896dcae83f007280fe59c1d70c01772971fe7240e89c8423fc9fbdbe36521cc WatchSource:0}: Error finding container e896dcae83f007280fe59c1d70c01772971fe7240e89c8423fc9fbdbe36521cc: Status 404 returned error can't find the container with id e896dcae83f007280fe59c1d70c01772971fe7240e89c8423fc9fbdbe36521cc
Sep 06 10:26:48.424473 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:48.424434    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7scd5" event={"ID":"3d6d17cc-95fa-4644-90f2-79dfda62db96","Type":"ContainerStarted","Data":"0fb5b161ecbcd081afcff0f85e3eacd3e008ad549c2641d647a9d520c364c688"}
Sep 06 10:26:48.425702 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:48.425676    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jtfgl" event={"ID":"754d046c-c778-49e0-b609-1f11e839568c","Type":"ContainerStarted","Data":"e896dcae83f007280fe59c1d70c01772971fe7240e89c8423fc9fbdbe36521cc"}
Sep 06 10:26:48.641856 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:48.641824    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/1.log"
Sep 06 10:26:48.644967 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:48.644941    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/1.log"
Sep 06 10:26:48.648433 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:48.648414    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsw6t_a4733769-37b3-443b-9ee5-d93bd5f167f0/ovn-acl-logging/0.log"
Sep 06 10:26:48.651186 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:48.651170    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsw6t_a4733769-37b3-443b-9ee5-d93bd5f167f0/ovn-acl-logging/0.log"
Sep 06 10:26:48.658668 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:48.658652    2561 kubelet.go:1648] "Image garbage collection succeeded"
Sep 06 10:26:48.704478 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:48.704301    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:48.812533 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:48.812478    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:48.911213 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:48.911172    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:26:52.454068 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:52.454033    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jtfgl" event={"ID":"754d046c-c778-49e0-b609-1f11e839568c","Type":"ContainerStarted","Data":"aeb8223ac6fa83e890415985da09386cef6f0289733ed47e2ec4cebd1faf0d38"}
Sep 06 10:26:52.454575 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:52.454242    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jtfgl"
Sep 06 10:26:52.456131 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:52.456094    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7scd5" event={"ID":"3d6d17cc-95fa-4644-90f2-79dfda62db96","Type":"ContainerStarted","Data":"c4627d75ef276192f9c2439f69fba5327ee8085f7870166c89ff8550d799b351"}
Sep 06 10:26:52.456268 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:52.456242    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7scd5"
Sep 06 10:26:52.470678 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:52.470627    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jtfgl" podStartSLOduration=1.81773857 podStartE2EDuration="5.470613982s" totalImagesPullingTime="3.652875412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:26:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:26:52.469315311 +0000 UTC m=+304.247734737" watchObservedRunningTime="2026-09-06 10:26:52.470613982 +0000 UTC m=+304.249033395"
Sep 06 10:26:52.484665 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:26:52.484623    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7scd5" podStartSLOduration=1.8076782470000001 podStartE2EDuration="5.48461051s" totalImagesPullingTime="3.676932263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:26:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:26:52.483789129 +0000 UTC m=+304.262208555" watchObservedRunningTime="2026-09-06 10:26:52.48461051 +0000 UTC m=+304.263029922"
Sep 06 10:27:23.463541 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:23.463509    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jtfgl"
Sep 06 10:27:23.466878 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:23.466859    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7scd5"
Sep 06 10:27:39.231709 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:39.231672    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:27:40.607644 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:40.607608    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:27:42.625803 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.625726    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495"]
Sep 06 10:27:42.629231 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.629207    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495"
Sep 06 10:27:42.631922 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.631877    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 06 10:27:42.632039 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.631926    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bc9cp\""
Sep 06 10:27:42.632039 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.631936    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 06 10:27:42.638906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.638881    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495"]
Sep 06 10:27:42.716270 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.716233    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p"]
Sep 06 10:27:42.719568 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.719541    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4wvj\" (UniqueName: \"kubernetes.io/projected/df368f49-1c87-4652-94c9-2b41d694b3d9-kube-api-access-h4wvj\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495\" (UID: \"df368f49-1c87-4652-94c9-2b41d694b3d9\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495"
Sep 06 10:27:42.719697 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.719576    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df368f49-1c87-4652-94c9-2b41d694b3d9-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495\" (UID: \"df368f49-1c87-4652-94c9-2b41d694b3d9\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495"
Sep 06 10:27:42.719697 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.719665    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df368f49-1c87-4652-94c9-2b41d694b3d9-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495\" (UID: \"df368f49-1c87-4652-94c9-2b41d694b3d9\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495"
Sep 06 10:27:42.719866 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.719851    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p"
Sep 06 10:27:42.727871 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.727844    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p"]
Sep 06 10:27:42.821150 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.821111    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb119aac-520a-4b78-9a45-9e08908d5747-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p\" (UID: \"eb119aac-520a-4b78-9a45-9e08908d5747\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p"
Sep 06 10:27:42.821150 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.821154    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4wvj\" (UniqueName: \"kubernetes.io/projected/df368f49-1c87-4652-94c9-2b41d694b3d9-kube-api-access-h4wvj\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495\" (UID: \"df368f49-1c87-4652-94c9-2b41d694b3d9\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495"
Sep 06 10:27:42.821449 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.821176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df368f49-1c87-4652-94c9-2b41d694b3d9-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495\" (UID: \"df368f49-1c87-4652-94c9-2b41d694b3d9\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495"
Sep 06 10:27:42.821449 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.821265    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z9md\" (UniqueName: \"kubernetes.io/projected/eb119aac-520a-4b78-9a45-9e08908d5747-kube-api-access-6z9md\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p\" (UID: \"eb119aac-520a-4b78-9a45-9e08908d5747\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p"
Sep 06 10:27:42.821449 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.821358    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df368f49-1c87-4652-94c9-2b41d694b3d9-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495\" (UID: \"df368f49-1c87-4652-94c9-2b41d694b3d9\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495"
Sep 06 10:27:42.821449 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.821385    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb119aac-520a-4b78-9a45-9e08908d5747-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p\" (UID: \"eb119aac-520a-4b78-9a45-9e08908d5747\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p"
Sep 06 10:27:42.821711 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.821690    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df368f49-1c87-4652-94c9-2b41d694b3d9-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495\" (UID: \"df368f49-1c87-4652-94c9-2b41d694b3d9\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495"
Sep 06 10:27:42.821711 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.821706    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df368f49-1c87-4652-94c9-2b41d694b3d9-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495\" (UID: \"df368f49-1c87-4652-94c9-2b41d694b3d9\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495"
Sep 06 10:27:42.829254 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.829227    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574"]
Sep 06 10:27:42.832026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.832003    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4wvj\" (UniqueName: \"kubernetes.io/projected/df368f49-1c87-4652-94c9-2b41d694b3d9-kube-api-access-h4wvj\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495\" (UID: \"df368f49-1c87-4652-94c9-2b41d694b3d9\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495"
Sep 06 10:27:42.832972 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.832956    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574"
Sep 06 10:27:42.840630 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.840605    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574"]
Sep 06 10:27:42.921937 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.921904    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq"]
Sep 06 10:27:42.922265 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.922244    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z9md\" (UniqueName: \"kubernetes.io/projected/eb119aac-520a-4b78-9a45-9e08908d5747-kube-api-access-6z9md\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p\" (UID: \"eb119aac-520a-4b78-9a45-9e08908d5747\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p"
Sep 06 10:27:42.922354 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.922285    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb119aac-520a-4b78-9a45-9e08908d5747-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p\" (UID: \"eb119aac-520a-4b78-9a45-9e08908d5747\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p"
Sep 06 10:27:42.922354 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.922312    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjf5x\" (UniqueName: \"kubernetes.io/projected/9a2a86ed-377f-40bd-af2a-97ddef198cb0-kube-api-access-mjf5x\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574\" (UID: \"9a2a86ed-377f-40bd-af2a-97ddef198cb0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574"
Sep 06 10:27:42.922447 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.922373    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a2a86ed-377f-40bd-af2a-97ddef198cb0-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574\" (UID: \"9a2a86ed-377f-40bd-af2a-97ddef198cb0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574"
Sep 06 10:27:42.922484 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.922444    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a2a86ed-377f-40bd-af2a-97ddef198cb0-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574\" (UID: \"9a2a86ed-377f-40bd-af2a-97ddef198cb0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574"
Sep 06 10:27:42.922484 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.922466    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb119aac-520a-4b78-9a45-9e08908d5747-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p\" (UID: \"eb119aac-520a-4b78-9a45-9e08908d5747\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p"
Sep 06 10:27:42.922760 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.922741    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb119aac-520a-4b78-9a45-9e08908d5747-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p\" (UID: \"eb119aac-520a-4b78-9a45-9e08908d5747\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p"
Sep 06 10:27:42.922797 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.922751    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb119aac-520a-4b78-9a45-9e08908d5747-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p\" (UID: \"eb119aac-520a-4b78-9a45-9e08908d5747\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p"
Sep 06 10:27:42.925531 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.925516    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq"
Sep 06 10:27:42.932571 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.932445    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq"]
Sep 06 10:27:42.934114 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.934083    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z9md\" (UniqueName: \"kubernetes.io/projected/eb119aac-520a-4b78-9a45-9e08908d5747-kube-api-access-6z9md\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p\" (UID: \"eb119aac-520a-4b78-9a45-9e08908d5747\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p"
Sep 06 10:27:42.938990 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:42.938962    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495"
Sep 06 10:27:43.024084 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.024029    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjf5x\" (UniqueName: \"kubernetes.io/projected/9a2a86ed-377f-40bd-af2a-97ddef198cb0-kube-api-access-mjf5x\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574\" (UID: \"9a2a86ed-377f-40bd-af2a-97ddef198cb0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574"
Sep 06 10:27:43.024273 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.024093    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a2a86ed-377f-40bd-af2a-97ddef198cb0-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574\" (UID: \"9a2a86ed-377f-40bd-af2a-97ddef198cb0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574"
Sep 06 10:27:43.024273 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.024179    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a2a86ed-377f-40bd-af2a-97ddef198cb0-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574\" (UID: \"9a2a86ed-377f-40bd-af2a-97ddef198cb0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574"
Sep 06 10:27:43.024273 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.024256    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnkds\" (UniqueName: \"kubernetes.io/projected/c17c84ae-8e69-4526-97b3-a7cdac14cd63-kube-api-access-rnkds\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq\" (UID: \"c17c84ae-8e69-4526-97b3-a7cdac14cd63\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq"
Sep 06 10:27:43.024482 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.024309    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c17c84ae-8e69-4526-97b3-a7cdac14cd63-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq\" (UID: \"c17c84ae-8e69-4526-97b3-a7cdac14cd63\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq"
Sep 06 10:27:43.024482 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.024362    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c17c84ae-8e69-4526-97b3-a7cdac14cd63-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq\" (UID: \"c17c84ae-8e69-4526-97b3-a7cdac14cd63\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq"
Sep 06 10:27:43.025142 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.025110    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a2a86ed-377f-40bd-af2a-97ddef198cb0-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574\" (UID: \"9a2a86ed-377f-40bd-af2a-97ddef198cb0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574"
Sep 06 10:27:43.025422 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.025401    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a2a86ed-377f-40bd-af2a-97ddef198cb0-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574\" (UID: \"9a2a86ed-377f-40bd-af2a-97ddef198cb0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574"
Sep 06 10:27:43.030539 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.030340    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p"
Sep 06 10:27:43.033283 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.033254    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjf5x\" (UniqueName: \"kubernetes.io/projected/9a2a86ed-377f-40bd-af2a-97ddef198cb0-kube-api-access-mjf5x\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574\" (UID: \"9a2a86ed-377f-40bd-af2a-97ddef198cb0\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574"
Sep 06 10:27:43.125804 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.125766    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnkds\" (UniqueName: \"kubernetes.io/projected/c17c84ae-8e69-4526-97b3-a7cdac14cd63-kube-api-access-rnkds\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq\" (UID: \"c17c84ae-8e69-4526-97b3-a7cdac14cd63\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq"
Sep 06 10:27:43.125804 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.125808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c17c84ae-8e69-4526-97b3-a7cdac14cd63-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq\" (UID: \"c17c84ae-8e69-4526-97b3-a7cdac14cd63\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq"
Sep 06 10:27:43.126040 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.125833    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c17c84ae-8e69-4526-97b3-a7cdac14cd63-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq\" (UID: \"c17c84ae-8e69-4526-97b3-a7cdac14cd63\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq"
Sep 06 10:27:43.126262 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.126242    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c17c84ae-8e69-4526-97b3-a7cdac14cd63-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq\" (UID: \"c17c84ae-8e69-4526-97b3-a7cdac14cd63\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq"
Sep 06 10:27:43.126300 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.126241    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c17c84ae-8e69-4526-97b3-a7cdac14cd63-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq\" (UID: \"c17c84ae-8e69-4526-97b3-a7cdac14cd63\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq"
Sep 06 10:27:43.142371 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.142337    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnkds\" (UniqueName: \"kubernetes.io/projected/c17c84ae-8e69-4526-97b3-a7cdac14cd63-kube-api-access-rnkds\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq\" (UID: \"c17c84ae-8e69-4526-97b3-a7cdac14cd63\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq"
Sep 06 10:27:43.150117 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.150098    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574"
Sep 06 10:27:43.235527 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.235248    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq"
Sep 06 10:27:43.237009 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.236804    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495"]
Sep 06 10:27:43.240518 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:27:43.240487    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf368f49_1c87_4652_94c9_2b41d694b3d9.slice/crio-45e861b2258782e93b4f2e23a390ace4aa48b797e4d6af7738e6de7290ac2b4c WatchSource:0}: Error finding container 45e861b2258782e93b4f2e23a390ace4aa48b797e4d6af7738e6de7290ac2b4c: Status 404 returned error can't find the container with id 45e861b2258782e93b4f2e23a390ace4aa48b797e4d6af7738e6de7290ac2b4c
Sep 06 10:27:43.307760 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.307730    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p"]
Sep 06 10:27:43.309057 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:27:43.309025    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb119aac_520a_4b78_9a45_9e08908d5747.slice/crio-0b1e2f3bd3f45a330d388f1351f6aeea71456bdf7f90208e59f24e0c04f2aff9 WatchSource:0}: Error finding container 0b1e2f3bd3f45a330d388f1351f6aeea71456bdf7f90208e59f24e0c04f2aff9: Status 404 returned error can't find the container with id 0b1e2f3bd3f45a330d388f1351f6aeea71456bdf7f90208e59f24e0c04f2aff9
Sep 06 10:27:43.430066 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.430031    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574"]
Sep 06 10:27:43.481371 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:27:43.481277    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a2a86ed_377f_40bd_af2a_97ddef198cb0.slice/crio-db8cff4ccf4f7ae2d765609744a79d1531e83cbfc05b3395c6ac19ee3d49a3d1 WatchSource:0}: Error finding container db8cff4ccf4f7ae2d765609744a79d1531e83cbfc05b3395c6ac19ee3d49a3d1: Status 404 returned error can't find the container with id db8cff4ccf4f7ae2d765609744a79d1531e83cbfc05b3395c6ac19ee3d49a3d1
Sep 06 10:27:43.517259 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.517232    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq"]
Sep 06 10:27:43.519234 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:27:43.519207    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc17c84ae_8e69_4526_97b3_a7cdac14cd63.slice/crio-c7e785e2ed4d3dd0b98dba3461a1067b713817e72048026d396efa7254deb97e WatchSource:0}: Error finding container c7e785e2ed4d3dd0b98dba3461a1067b713817e72048026d396efa7254deb97e: Status 404 returned error can't find the container with id c7e785e2ed4d3dd0b98dba3461a1067b713817e72048026d396efa7254deb97e
Sep 06 10:27:43.716902 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.716862    2561 generic.go:356] "Generic (PLEG): container finished" podID="c17c84ae-8e69-4526-97b3-a7cdac14cd63" containerID="96d21f0b75585a5c9924086a1652b63d73c8bf8a448801f1701ace1f720eec4e" exitCode=0
Sep 06 10:27:43.717318 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.716948    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq" event={"ID":"c17c84ae-8e69-4526-97b3-a7cdac14cd63","Type":"ContainerDied","Data":"96d21f0b75585a5c9924086a1652b63d73c8bf8a448801f1701ace1f720eec4e"}
Sep 06 10:27:43.717318 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.717003    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq" event={"ID":"c17c84ae-8e69-4526-97b3-a7cdac14cd63","Type":"ContainerStarted","Data":"c7e785e2ed4d3dd0b98dba3461a1067b713817e72048026d396efa7254deb97e"}
Sep 06 10:27:43.718042 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.718025    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 10:27:43.718687 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.718666    2561 generic.go:356] "Generic (PLEG): container finished" podID="df368f49-1c87-4652-94c9-2b41d694b3d9" containerID="e76a0f5d6642564d07cb8633d8ab72517f31391edd311c6ab203ad82c5ef267f" exitCode=0
Sep 06 10:27:43.718752 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.718731    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495" event={"ID":"df368f49-1c87-4652-94c9-2b41d694b3d9","Type":"ContainerDied","Data":"e76a0f5d6642564d07cb8633d8ab72517f31391edd311c6ab203ad82c5ef267f"}
Sep 06 10:27:43.718807 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.718779    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495" event={"ID":"df368f49-1c87-4652-94c9-2b41d694b3d9","Type":"ContainerStarted","Data":"45e861b2258782e93b4f2e23a390ace4aa48b797e4d6af7738e6de7290ac2b4c"}
Sep 06 10:27:43.720627 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.720606    2561 generic.go:356] "Generic (PLEG): container finished" podID="eb119aac-520a-4b78-9a45-9e08908d5747" containerID="84e5c5972e7cbf7ec1612df525d5d86bfb071e7e7386c22ab768cd0a1e583b16" exitCode=0
Sep 06 10:27:43.720730 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.720672    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p" event={"ID":"eb119aac-520a-4b78-9a45-9e08908d5747","Type":"ContainerDied","Data":"84e5c5972e7cbf7ec1612df525d5d86bfb071e7e7386c22ab768cd0a1e583b16"}
Sep 06 10:27:43.720730 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.720721    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p" event={"ID":"eb119aac-520a-4b78-9a45-9e08908d5747","Type":"ContainerStarted","Data":"0b1e2f3bd3f45a330d388f1351f6aeea71456bdf7f90208e59f24e0c04f2aff9"}
Sep 06 10:27:43.722422 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.722396    2561 generic.go:356] "Generic (PLEG): container finished" podID="9a2a86ed-377f-40bd-af2a-97ddef198cb0" containerID="08c40baa53ac393a5389c053bbf08f38641d963c8796f19787caa5828558f20d" exitCode=0
Sep 06 10:27:43.722513 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.722447    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574" event={"ID":"9a2a86ed-377f-40bd-af2a-97ddef198cb0","Type":"ContainerDied","Data":"08c40baa53ac393a5389c053bbf08f38641d963c8796f19787caa5828558f20d"}
Sep 06 10:27:43.722513 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:43.722486    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574" event={"ID":"9a2a86ed-377f-40bd-af2a-97ddef198cb0","Type":"ContainerStarted","Data":"db8cff4ccf4f7ae2d765609744a79d1531e83cbfc05b3395c6ac19ee3d49a3d1"}
Sep 06 10:27:45.735051 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:45.735016    2561 generic.go:356] "Generic (PLEG): container finished" podID="9a2a86ed-377f-40bd-af2a-97ddef198cb0" containerID="0db4cbbf0fbb354d32a536bbdbe7ee1fd2228bf508314bff65dde9101b2a465c" exitCode=0
Sep 06 10:27:45.735487 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:45.735095    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574" event={"ID":"9a2a86ed-377f-40bd-af2a-97ddef198cb0","Type":"ContainerDied","Data":"0db4cbbf0fbb354d32a536bbdbe7ee1fd2228bf508314bff65dde9101b2a465c"}
Sep 06 10:27:45.736998 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:45.736975    2561 generic.go:356] "Generic (PLEG): container finished" podID="c17c84ae-8e69-4526-97b3-a7cdac14cd63" containerID="7a67b43dd1234fdc2efa9c55744f794c48051f86e2c4b08be0c5d668653dc8aa" exitCode=0
Sep 06 10:27:45.737079 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:45.737062    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq" event={"ID":"c17c84ae-8e69-4526-97b3-a7cdac14cd63","Type":"ContainerDied","Data":"7a67b43dd1234fdc2efa9c55744f794c48051f86e2c4b08be0c5d668653dc8aa"}
Sep 06 10:27:45.739040 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:45.739018    2561 generic.go:356] "Generic (PLEG): container finished" podID="df368f49-1c87-4652-94c9-2b41d694b3d9" containerID="ea3053ddff05c7aea7fc8f2013338e338d87c6ebf69503ee29e071d109afb324" exitCode=0
Sep 06 10:27:45.739139 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:45.739120    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495" event={"ID":"df368f49-1c87-4652-94c9-2b41d694b3d9","Type":"ContainerDied","Data":"ea3053ddff05c7aea7fc8f2013338e338d87c6ebf69503ee29e071d109afb324"}
Sep 06 10:27:45.741113 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:45.741091    2561 generic.go:356] "Generic (PLEG): container finished" podID="eb119aac-520a-4b78-9a45-9e08908d5747" containerID="8250b58c2f0efc200a83a0aaff8e9d4f3474769db925f900e51fd7c195f78c50" exitCode=0
Sep 06 10:27:45.741174 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:45.741151    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p" event={"ID":"eb119aac-520a-4b78-9a45-9e08908d5747","Type":"ContainerDied","Data":"8250b58c2f0efc200a83a0aaff8e9d4f3474769db925f900e51fd7c195f78c50"}
Sep 06 10:27:46.754926 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:46.754889    2561 generic.go:356] "Generic (PLEG): container finished" podID="c17c84ae-8e69-4526-97b3-a7cdac14cd63" containerID="9632d9ea7ba61cba00725af1b18209098f76792ed82db3b2d987c83e4421239e" exitCode=0
Sep 06 10:27:46.755926 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:46.755901    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq" event={"ID":"c17c84ae-8e69-4526-97b3-a7cdac14cd63","Type":"ContainerDied","Data":"9632d9ea7ba61cba00725af1b18209098f76792ed82db3b2d987c83e4421239e"}
Sep 06 10:27:46.757183 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:46.757162    2561 generic.go:356] "Generic (PLEG): container finished" podID="df368f49-1c87-4652-94c9-2b41d694b3d9" containerID="7d2c9b7e48a61d130177ad70a9bc09f52aeca4aed1872985c6811b3c63696717" exitCode=0
Sep 06 10:27:46.757285 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:46.757251    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495" event={"ID":"df368f49-1c87-4652-94c9-2b41d694b3d9","Type":"ContainerDied","Data":"7d2c9b7e48a61d130177ad70a9bc09f52aeca4aed1872985c6811b3c63696717"}
Sep 06 10:27:46.759406 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:46.759386    2561 generic.go:356] "Generic (PLEG): container finished" podID="eb119aac-520a-4b78-9a45-9e08908d5747" containerID="21cbb7a44de8effbfa9f0bfe9c9b4f9b51f9cfd7e420784d135bd8f950f0bfbd" exitCode=0
Sep 06 10:27:46.759504 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:46.759432    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p" event={"ID":"eb119aac-520a-4b78-9a45-9e08908d5747","Type":"ContainerDied","Data":"21cbb7a44de8effbfa9f0bfe9c9b4f9b51f9cfd7e420784d135bd8f950f0bfbd"}
Sep 06 10:27:46.761594 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:46.761576    2561 generic.go:356] "Generic (PLEG): container finished" podID="9a2a86ed-377f-40bd-af2a-97ddef198cb0" containerID="4b8281a1fc6a235c1a6916375aabb48fe0e6b296c3c3d2e9783cd57a15eeb607" exitCode=0
Sep 06 10:27:46.761673 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:46.761611    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574" event={"ID":"9a2a86ed-377f-40bd-af2a-97ddef198cb0","Type":"ContainerDied","Data":"4b8281a1fc6a235c1a6916375aabb48fe0e6b296c3c3d2e9783cd57a15eeb607"}
Sep 06 10:27:47.937463 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:47.937429    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq"
Sep 06 10:27:47.962915 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:47.962885    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p"
Sep 06 10:27:47.966932 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:47.966908    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574"
Sep 06 10:27:47.970222 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:47.970200    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495"
Sep 06 10:27:48.067104 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.067014    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb119aac-520a-4b78-9a45-9e08908d5747-util\") pod \"eb119aac-520a-4b78-9a45-9e08908d5747\" (UID: \"eb119aac-520a-4b78-9a45-9e08908d5747\") "
Sep 06 10:27:48.067104 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.067056    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df368f49-1c87-4652-94c9-2b41d694b3d9-util\") pod \"df368f49-1c87-4652-94c9-2b41d694b3d9\" (UID: \"df368f49-1c87-4652-94c9-2b41d694b3d9\") "
Sep 06 10:27:48.067104 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.067100    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnkds\" (UniqueName: \"kubernetes.io/projected/c17c84ae-8e69-4526-97b3-a7cdac14cd63-kube-api-access-rnkds\") pod \"c17c84ae-8e69-4526-97b3-a7cdac14cd63\" (UID: \"c17c84ae-8e69-4526-97b3-a7cdac14cd63\") "
Sep 06 10:27:48.067403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.067122    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c17c84ae-8e69-4526-97b3-a7cdac14cd63-util\") pod \"c17c84ae-8e69-4526-97b3-a7cdac14cd63\" (UID: \"c17c84ae-8e69-4526-97b3-a7cdac14cd63\") "
Sep 06 10:27:48.067403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.067150    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df368f49-1c87-4652-94c9-2b41d694b3d9-bundle\") pod \"df368f49-1c87-4652-94c9-2b41d694b3d9\" (UID: \"df368f49-1c87-4652-94c9-2b41d694b3d9\") "
Sep 06 10:27:48.067403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.067200    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c17c84ae-8e69-4526-97b3-a7cdac14cd63-bundle\") pod \"c17c84ae-8e69-4526-97b3-a7cdac14cd63\" (UID: \"c17c84ae-8e69-4526-97b3-a7cdac14cd63\") "
Sep 06 10:27:48.067403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.067237    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb119aac-520a-4b78-9a45-9e08908d5747-bundle\") pod \"eb119aac-520a-4b78-9a45-9e08908d5747\" (UID: \"eb119aac-520a-4b78-9a45-9e08908d5747\") "
Sep 06 10:27:48.067403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.067271    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4wvj\" (UniqueName: \"kubernetes.io/projected/df368f49-1c87-4652-94c9-2b41d694b3d9-kube-api-access-h4wvj\") pod \"df368f49-1c87-4652-94c9-2b41d694b3d9\" (UID: \"df368f49-1c87-4652-94c9-2b41d694b3d9\") "
Sep 06 10:27:48.067403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.067294    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjf5x\" (UniqueName: \"kubernetes.io/projected/9a2a86ed-377f-40bd-af2a-97ddef198cb0-kube-api-access-mjf5x\") pod \"9a2a86ed-377f-40bd-af2a-97ddef198cb0\" (UID: \"9a2a86ed-377f-40bd-af2a-97ddef198cb0\") "
Sep 06 10:27:48.067403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.067345    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6z9md\" (UniqueName: \"kubernetes.io/projected/eb119aac-520a-4b78-9a45-9e08908d5747-kube-api-access-6z9md\") pod \"eb119aac-520a-4b78-9a45-9e08908d5747\" (UID: \"eb119aac-520a-4b78-9a45-9e08908d5747\") "
Sep 06 10:27:48.067403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.067390    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a2a86ed-377f-40bd-af2a-97ddef198cb0-bundle\") pod \"9a2a86ed-377f-40bd-af2a-97ddef198cb0\" (UID: \"9a2a86ed-377f-40bd-af2a-97ddef198cb0\") "
Sep 06 10:27:48.067800 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.067431    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a2a86ed-377f-40bd-af2a-97ddef198cb0-util\") pod \"9a2a86ed-377f-40bd-af2a-97ddef198cb0\" (UID: \"9a2a86ed-377f-40bd-af2a-97ddef198cb0\") "
Sep 06 10:27:48.068268 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.068070    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c17c84ae-8e69-4526-97b3-a7cdac14cd63-bundle" (OuterVolumeSpecName: "bundle") pod "c17c84ae-8e69-4526-97b3-a7cdac14cd63" (UID: "c17c84ae-8e69-4526-97b3-a7cdac14cd63"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:27:48.068268 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.068075    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df368f49-1c87-4652-94c9-2b41d694b3d9-bundle" (OuterVolumeSpecName: "bundle") pod "df368f49-1c87-4652-94c9-2b41d694b3d9" (UID: "df368f49-1c87-4652-94c9-2b41d694b3d9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:27:48.068592 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.068570    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb119aac-520a-4b78-9a45-9e08908d5747-bundle" (OuterVolumeSpecName: "bundle") pod "eb119aac-520a-4b78-9a45-9e08908d5747" (UID: "eb119aac-520a-4b78-9a45-9e08908d5747"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:27:48.069146 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.069119    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2a86ed-377f-40bd-af2a-97ddef198cb0-bundle" (OuterVolumeSpecName: "bundle") pod "9a2a86ed-377f-40bd-af2a-97ddef198cb0" (UID: "9a2a86ed-377f-40bd-af2a-97ddef198cb0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:27:48.070419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.070391    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c17c84ae-8e69-4526-97b3-a7cdac14cd63-kube-api-access-rnkds" (OuterVolumeSpecName: "kube-api-access-rnkds") pod "c17c84ae-8e69-4526-97b3-a7cdac14cd63" (UID: "c17c84ae-8e69-4526-97b3-a7cdac14cd63"). InnerVolumeSpecName "kube-api-access-rnkds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:27:48.070680 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.070649    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df368f49-1c87-4652-94c9-2b41d694b3d9-kube-api-access-h4wvj" (OuterVolumeSpecName: "kube-api-access-h4wvj") pod "df368f49-1c87-4652-94c9-2b41d694b3d9" (UID: "df368f49-1c87-4652-94c9-2b41d694b3d9"). InnerVolumeSpecName "kube-api-access-h4wvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:27:48.071354 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.071302    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a2a86ed-377f-40bd-af2a-97ddef198cb0-kube-api-access-mjf5x" (OuterVolumeSpecName: "kube-api-access-mjf5x") pod "9a2a86ed-377f-40bd-af2a-97ddef198cb0" (UID: "9a2a86ed-377f-40bd-af2a-97ddef198cb0"). InnerVolumeSpecName "kube-api-access-mjf5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:27:48.071469 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.071443    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb119aac-520a-4b78-9a45-9e08908d5747-kube-api-access-6z9md" (OuterVolumeSpecName: "kube-api-access-6z9md") pod "eb119aac-520a-4b78-9a45-9e08908d5747" (UID: "eb119aac-520a-4b78-9a45-9e08908d5747"). InnerVolumeSpecName "kube-api-access-6z9md". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:27:48.074038 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.074002    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c17c84ae-8e69-4526-97b3-a7cdac14cd63-util" (OuterVolumeSpecName: "util") pod "c17c84ae-8e69-4526-97b3-a7cdac14cd63" (UID: "c17c84ae-8e69-4526-97b3-a7cdac14cd63"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:27:48.074709 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.074690    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb119aac-520a-4b78-9a45-9e08908d5747-util" (OuterVolumeSpecName: "util") pod "eb119aac-520a-4b78-9a45-9e08908d5747" (UID: "eb119aac-520a-4b78-9a45-9e08908d5747"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:27:48.074821 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.074802    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a2a86ed-377f-40bd-af2a-97ddef198cb0-util" (OuterVolumeSpecName: "util") pod "9a2a86ed-377f-40bd-af2a-97ddef198cb0" (UID: "9a2a86ed-377f-40bd-af2a-97ddef198cb0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:27:48.075038 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.075015    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df368f49-1c87-4652-94c9-2b41d694b3d9-util" (OuterVolumeSpecName: "util") pod "df368f49-1c87-4652-94c9-2b41d694b3d9" (UID: "df368f49-1c87-4652-94c9-2b41d694b3d9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:27:48.168994 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.168953    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnkds\" (UniqueName: \"kubernetes.io/projected/c17c84ae-8e69-4526-97b3-a7cdac14cd63-kube-api-access-rnkds\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:27:48.168994 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.168989    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c17c84ae-8e69-4526-97b3-a7cdac14cd63-util\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:27:48.168994 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.169001    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/df368f49-1c87-4652-94c9-2b41d694b3d9-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:27:48.169234 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.169009    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c17c84ae-8e69-4526-97b3-a7cdac14cd63-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:27:48.169234 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.169017    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb119aac-520a-4b78-9a45-9e08908d5747-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:27:48.169234 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.169025    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4wvj\" (UniqueName: \"kubernetes.io/projected/df368f49-1c87-4652-94c9-2b41d694b3d9-kube-api-access-h4wvj\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:27:48.169234 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.169034    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjf5x\" (UniqueName: \"kubernetes.io/projected/9a2a86ed-377f-40bd-af2a-97ddef198cb0-kube-api-access-mjf5x\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:27:48.169234 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.169043    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6z9md\" (UniqueName: \"kubernetes.io/projected/eb119aac-520a-4b78-9a45-9e08908d5747-kube-api-access-6z9md\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:27:48.169234 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.169051    2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a2a86ed-377f-40bd-af2a-97ddef198cb0-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:27:48.169234 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.169058    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a2a86ed-377f-40bd-af2a-97ddef198cb0-util\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:27:48.169234 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.169066    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb119aac-520a-4b78-9a45-9e08908d5747-util\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:27:48.169234 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.169074    2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/df368f49-1c87-4652-94c9-2b41d694b3d9-util\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:27:48.773095 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.773075    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p"
Sep 06 10:27:48.773095 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.773086    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0nrg9p" event={"ID":"eb119aac-520a-4b78-9a45-9e08908d5747","Type":"ContainerDied","Data":"0b1e2f3bd3f45a330d388f1351f6aeea71456bdf7f90208e59f24e0c04f2aff9"}
Sep 06 10:27:48.773238 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.773132    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b1e2f3bd3f45a330d388f1351f6aeea71456bdf7f90208e59f24e0c04f2aff9"
Sep 06 10:27:48.775364 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.775348    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574"
Sep 06 10:27:48.775451 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.775397    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c6z574" event={"ID":"9a2a86ed-377f-40bd-af2a-97ddef198cb0","Type":"ContainerDied","Data":"db8cff4ccf4f7ae2d765609744a79d1531e83cbfc05b3395c6ac19ee3d49a3d1"}
Sep 06 10:27:48.775451 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.775433    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db8cff4ccf4f7ae2d765609744a79d1531e83cbfc05b3395c6ac19ee3d49a3d1"
Sep 06 10:27:48.777562 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.777540    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq" event={"ID":"c17c84ae-8e69-4526-97b3-a7cdac14cd63","Type":"ContainerDied","Data":"c7e785e2ed4d3dd0b98dba3461a1067b713817e72048026d396efa7254deb97e"}
Sep 06 10:27:48.777666 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.777579    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7e785e2ed4d3dd0b98dba3461a1067b713817e72048026d396efa7254deb97e"
Sep 06 10:27:48.777666 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.777641    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bb884qq"
Sep 06 10:27:48.782874 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.781680    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495" event={"ID":"df368f49-1c87-4652-94c9-2b41d694b3d9","Type":"ContainerDied","Data":"45e861b2258782e93b4f2e23a390ace4aa48b797e4d6af7738e6de7290ac2b4c"}
Sep 06 10:27:48.782874 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.781728    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45e861b2258782e93b4f2e23a390ace4aa48b797e4d6af7738e6de7290ac2b4c"
Sep 06 10:27:48.782874 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:48.781803    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053bp495"
Sep 06 10:27:52.702767 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:52.702718    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:27:55.293102 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:55.293072    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:27:55.684539 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:55.684504    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:27:56.087806 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:56.087723    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:27:56.887955 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:56.887926    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:27:56.989578 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:56.989546    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:27:58.964340 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:58.964288    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:27:59.697422 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:59.697390    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:27:59.978973 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:27:59.978879    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:00.074338 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:00.074284    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:01.088207 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088172    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-c2d2c"]
Sep 06 10:28:01.088593 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088562    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df368f49-1c87-4652-94c9-2b41d694b3d9" containerName="pull"
Sep 06 10:28:01.088593 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088577    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="df368f49-1c87-4652-94c9-2b41d694b3d9" containerName="pull"
Sep 06 10:28:01.088593 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088588    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c17c84ae-8e69-4526-97b3-a7cdac14cd63" containerName="extract"
Sep 06 10:28:01.088593 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088593    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c17c84ae-8e69-4526-97b3-a7cdac14cd63" containerName="extract"
Sep 06 10:28:01.088722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088600    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb119aac-520a-4b78-9a45-9e08908d5747" containerName="util"
Sep 06 10:28:01.088722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088606    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb119aac-520a-4b78-9a45-9e08908d5747" containerName="util"
Sep 06 10:28:01.088722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088616    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df368f49-1c87-4652-94c9-2b41d694b3d9" containerName="extract"
Sep 06 10:28:01.088722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088621    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="df368f49-1c87-4652-94c9-2b41d694b3d9" containerName="extract"
Sep 06 10:28:01.088722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088629    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c17c84ae-8e69-4526-97b3-a7cdac14cd63" containerName="util"
Sep 06 10:28:01.088722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088634    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c17c84ae-8e69-4526-97b3-a7cdac14cd63" containerName="util"
Sep 06 10:28:01.088722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088642    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb119aac-520a-4b78-9a45-9e08908d5747" containerName="pull"
Sep 06 10:28:01.088722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088648    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb119aac-520a-4b78-9a45-9e08908d5747" containerName="pull"
Sep 06 10:28:01.088722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088659    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c17c84ae-8e69-4526-97b3-a7cdac14cd63" containerName="pull"
Sep 06 10:28:01.088722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088665    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c17c84ae-8e69-4526-97b3-a7cdac14cd63" containerName="pull"
Sep 06 10:28:01.088722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088671    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb119aac-520a-4b78-9a45-9e08908d5747" containerName="extract"
Sep 06 10:28:01.088722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088676    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb119aac-520a-4b78-9a45-9e08908d5747" containerName="extract"
Sep 06 10:28:01.088722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088686    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a2a86ed-377f-40bd-af2a-97ddef198cb0" containerName="util"
Sep 06 10:28:01.088722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088690    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a2a86ed-377f-40bd-af2a-97ddef198cb0" containerName="util"
Sep 06 10:28:01.088722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088697    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df368f49-1c87-4652-94c9-2b41d694b3d9" containerName="util"
Sep 06 10:28:01.088722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088702    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="df368f49-1c87-4652-94c9-2b41d694b3d9" containerName="util"
Sep 06 10:28:01.088722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088707    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a2a86ed-377f-40bd-af2a-97ddef198cb0" containerName="pull"
Sep 06 10:28:01.088722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088712    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a2a86ed-377f-40bd-af2a-97ddef198cb0" containerName="pull"
Sep 06 10:28:01.088722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088716    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a2a86ed-377f-40bd-af2a-97ddef198cb0" containerName="extract"
Sep 06 10:28:01.088722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088722    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a2a86ed-377f-40bd-af2a-97ddef198cb0" containerName="extract"
Sep 06 10:28:01.089307 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088792    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a2a86ed-377f-40bd-af2a-97ddef198cb0" containerName="extract"
Sep 06 10:28:01.089307 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088801    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb119aac-520a-4b78-9a45-9e08908d5747" containerName="extract"
Sep 06 10:28:01.089307 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088814    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c17c84ae-8e69-4526-97b3-a7cdac14cd63" containerName="extract"
Sep 06 10:28:01.089307 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.088821    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="df368f49-1c87-4652-94c9-2b41d694b3d9" containerName="extract"
Sep 06 10:28:01.093208 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.093191    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-c2d2c"
Sep 06 10:28:01.095722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.095702    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 06 10:28:01.095842 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.095711    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 06 10:28:01.095914 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.095885    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 06 10:28:01.096351 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.096316    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-44rgc\""
Sep 06 10:28:01.102771 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.102749    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-c2d2c"]
Sep 06 10:28:01.185504 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.185476    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nhts\" (UniqueName: \"kubernetes.io/projected/9a62864d-9500-4b86-8c17-1912e1b096e4-kube-api-access-6nhts\") pod \"dns-operator-controller-manager-5985564776-c2d2c\" (UID: \"9a62864d-9500-4b86-8c17-1912e1b096e4\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-c2d2c"
Sep 06 10:28:01.281770 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.281740    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:01.285923 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.285894    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nhts\" (UniqueName: \"kubernetes.io/projected/9a62864d-9500-4b86-8c17-1912e1b096e4-kube-api-access-6nhts\") pod \"dns-operator-controller-manager-5985564776-c2d2c\" (UID: \"9a62864d-9500-4b86-8c17-1912e1b096e4\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-c2d2c"
Sep 06 10:28:01.297059 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.297036    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nhts\" (UniqueName: \"kubernetes.io/projected/9a62864d-9500-4b86-8c17-1912e1b096e4-kube-api-access-6nhts\") pod \"dns-operator-controller-manager-5985564776-c2d2c\" (UID: \"9a62864d-9500-4b86-8c17-1912e1b096e4\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-c2d2c"
Sep 06 10:28:01.404114 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.404084    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-c2d2c"
Sep 06 10:28:01.546227 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.546200    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:01.685998 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.685971    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-c2d2c"]
Sep 06 10:28:01.687868 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:28:01.687839    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a62864d_9500_4b86_8c17_1912e1b096e4.slice/crio-f68322d207aca384f5e30392a24f265a154bc301b14c645b1f9346dc278102d2 WatchSource:0}: Error finding container f68322d207aca384f5e30392a24f265a154bc301b14c645b1f9346dc278102d2: Status 404 returned error can't find the container with id f68322d207aca384f5e30392a24f265a154bc301b14c645b1f9346dc278102d2
Sep 06 10:28:01.692113 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.692084    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:01.801512 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.801477    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:01.852022 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:01.851987    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-c2d2c" event={"ID":"9a62864d-9500-4b86-8c17-1912e1b096e4","Type":"ContainerStarted","Data":"f68322d207aca384f5e30392a24f265a154bc301b14c645b1f9346dc278102d2"}
Sep 06 10:28:02.970453 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:02.970417    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:03.931794 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:03.931758    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-j8nq4"]
Sep 06 10:28:03.942269 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:03.942205    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-j8nq4"
Sep 06 10:28:03.944895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:03.944871    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-lrlvx\""
Sep 06 10:28:03.945701 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:03.945634    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-j8nq4"]
Sep 06 10:28:04.111752 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:04.111717    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84qj4\" (UniqueName: \"kubernetes.io/projected/ead5cd14-40cf-4099-b200-ad538f8967fb-kube-api-access-84qj4\") pod \"authorino-operator-68d88948d8-j8nq4\" (UID: \"ead5cd14-40cf-4099-b200-ad538f8967fb\") " pod="kuadrant-system/authorino-operator-68d88948d8-j8nq4"
Sep 06 10:28:04.212446 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:04.212366    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84qj4\" (UniqueName: \"kubernetes.io/projected/ead5cd14-40cf-4099-b200-ad538f8967fb-kube-api-access-84qj4\") pod \"authorino-operator-68d88948d8-j8nq4\" (UID: \"ead5cd14-40cf-4099-b200-ad538f8967fb\") " pod="kuadrant-system/authorino-operator-68d88948d8-j8nq4"
Sep 06 10:28:04.220908 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:04.220883    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84qj4\" (UniqueName: \"kubernetes.io/projected/ead5cd14-40cf-4099-b200-ad538f8967fb-kube-api-access-84qj4\") pod \"authorino-operator-68d88948d8-j8nq4\" (UID: \"ead5cd14-40cf-4099-b200-ad538f8967fb\") " pod="kuadrant-system/authorino-operator-68d88948d8-j8nq4"
Sep 06 10:28:04.255103 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:04.255074    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-j8nq4"
Sep 06 10:28:04.729518 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:04.729490    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-j8nq4"]
Sep 06 10:28:04.731316 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:28:04.731291    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podead5cd14_40cf_4099_b200_ad538f8967fb.slice/crio-58b510bff302b009e9071245d491b190cd9aaefb048ee2d13f3dec6c7e2666b0 WatchSource:0}: Error finding container 58b510bff302b009e9071245d491b190cd9aaefb048ee2d13f3dec6c7e2666b0: Status 404 returned error can't find the container with id 58b510bff302b009e9071245d491b190cd9aaefb048ee2d13f3dec6c7e2666b0
Sep 06 10:28:04.878367 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:04.878261    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-c2d2c" event={"ID":"9a62864d-9500-4b86-8c17-1912e1b096e4","Type":"ContainerStarted","Data":"80d6bcd0f2d8102f28abaf8e9c4f63ffd0f53b95a40ecc5efa424d528dd84a62"}
Sep 06 10:28:04.878507 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:04.878438    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-c2d2c"
Sep 06 10:28:04.879695 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:04.879669    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-j8nq4" event={"ID":"ead5cd14-40cf-4099-b200-ad538f8967fb","Type":"ContainerStarted","Data":"58b510bff302b009e9071245d491b190cd9aaefb048ee2d13f3dec6c7e2666b0"}
Sep 06 10:28:04.895921 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:04.895868    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-c2d2c" podStartSLOduration=1.062262413 podStartE2EDuration="3.895850213s" totalImagesPullingTime="2.8335878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:28:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:28:04.893019455 +0000 UTC m=+376.671438867" watchObservedRunningTime="2026-09-06 10:28:04.895850213 +0000 UTC m=+376.674269626"
Sep 06 10:28:05.287483 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:05.287433    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:05.391976 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:05.391943    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:06.407633 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:06.407598    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:06.665708 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:06.665638    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:06.891988 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:06.891949    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-j8nq4" event={"ID":"ead5cd14-40cf-4099-b200-ad538f8967fb","Type":"ContainerStarted","Data":"a31a46c34534e00ed93bc4db2c4211699827b0e6ee9116c51cec4f93b0c4ed0c"}
Sep 06 10:28:06.892158 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:06.892053    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-j8nq4"
Sep 06 10:28:06.909742 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:06.909697    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-j8nq4" podStartSLOduration=2.081821995 podStartE2EDuration="3.909682874s" totalImagesPullingTime="1.827860879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:28:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:28:06.909025949 +0000 UTC m=+378.687445373" watchObservedRunningTime="2026-09-06 10:28:06.909682874 +0000 UTC m=+378.688102286"
Sep 06 10:28:09.288566 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:09.288531    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:09.349523 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:09.349498    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:09.685800 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:09.685771    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:09.753515 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:09.753479    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:09.900448 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:09.900416    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:09.965251 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:09.965169    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:15.497573 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:15.497544    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:15.606278 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:15.606244    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:15.887065 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:15.886991    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-c2d2c"
Sep 06 10:28:17.899294 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:17.899261    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-j8nq4"
Sep 06 10:28:21.168839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.168767    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-dc7d7c8cd-92m2v"]
Sep 06 10:28:21.173853 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.173831    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.183706 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.183678    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dc7d7c8cd-92m2v"]
Sep 06 10:28:21.223297 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.223262    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:21.258557 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.258527    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5ee379c-5488-4e20-93bd-e8523e91534c-console-oauth-config\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.258557 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.258559    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5ee379c-5488-4e20-93bd-e8523e91534c-oauth-serving-cert\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.258788 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.258690    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5ee379c-5488-4e20-93bd-e8523e91534c-console-serving-cert\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.258788 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.258727    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5ee379c-5488-4e20-93bd-e8523e91534c-console-config\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.258788 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.258755    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5ee379c-5488-4e20-93bd-e8523e91534c-trusted-ca-bundle\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.258788 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.258785    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5ee379c-5488-4e20-93bd-e8523e91534c-service-ca\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.258949 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.258808    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cncsg\" (UniqueName: \"kubernetes.io/projected/e5ee379c-5488-4e20-93bd-e8523e91534c-kube-api-access-cncsg\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.281196 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.281168    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:21.359191 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.359158    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5ee379c-5488-4e20-93bd-e8523e91534c-console-serving-cert\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.359392 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.359195    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5ee379c-5488-4e20-93bd-e8523e91534c-console-config\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.359392 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.359221    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5ee379c-5488-4e20-93bd-e8523e91534c-trusted-ca-bundle\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.359392 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.359372    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5ee379c-5488-4e20-93bd-e8523e91534c-service-ca\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.359579 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.359414    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cncsg\" (UniqueName: \"kubernetes.io/projected/e5ee379c-5488-4e20-93bd-e8523e91534c-kube-api-access-cncsg\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.359579 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.359545    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5ee379c-5488-4e20-93bd-e8523e91534c-console-oauth-config\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.359579 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.359576    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5ee379c-5488-4e20-93bd-e8523e91534c-oauth-serving-cert\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.360050 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.360026    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e5ee379c-5488-4e20-93bd-e8523e91534c-console-config\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.360165 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.360136    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5ee379c-5488-4e20-93bd-e8523e91534c-trusted-ca-bundle\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.360343 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.360301    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e5ee379c-5488-4e20-93bd-e8523e91534c-service-ca\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.360410 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.360388    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e5ee379c-5488-4e20-93bd-e8523e91534c-oauth-serving-cert\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.361670 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.361650    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e5ee379c-5488-4e20-93bd-e8523e91534c-console-serving-cert\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.361947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.361930    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e5ee379c-5488-4e20-93bd-e8523e91534c-console-oauth-config\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.368585 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.368566    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cncsg\" (UniqueName: \"kubernetes.io/projected/e5ee379c-5488-4e20-93bd-e8523e91534c-kube-api-access-cncsg\") pod \"console-dc7d7c8cd-92m2v\" (UID: \"e5ee379c-5488-4e20-93bd-e8523e91534c\") " pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.485244 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.485151    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:21.767463 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.765177    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-dc7d7c8cd-92m2v"]
Sep 06 10:28:21.958996 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.958961    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:21.972261 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.972221    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc7d7c8cd-92m2v" event={"ID":"e5ee379c-5488-4e20-93bd-e8523e91534c","Type":"ContainerStarted","Data":"5d48cb63b5c9d9eb86c88b4a800ae28b7785e307e8484b30b7f858ca92fc40aa"}
Sep 06 10:28:21.972444 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.972280    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-dc7d7c8cd-92m2v" event={"ID":"e5ee379c-5488-4e20-93bd-e8523e91534c","Type":"ContainerStarted","Data":"5b4057ebc5761c9fdc7e504b4fc619d01572d6e5a5fb9c7d27316313d2be05c1"}
Sep 06 10:28:21.996834 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:21.996783    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-dc7d7c8cd-92m2v" podStartSLOduration=0.996769625 podStartE2EDuration="996.769625ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:28:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:28:21.994950508 +0000 UTC m=+393.773369921" watchObservedRunningTime="2026-09-06 10:28:21.996769625 +0000 UTC m=+393.775189038"
Sep 06 10:28:22.056679 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:22.056580    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:24.556561 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:24.556524    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:24.657108 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:24.657079    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:28.364682 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:28.364642    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:28.464547 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:28.464500    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:28.564724 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:28.564695    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:28.664828 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:28.664795    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:29.565376 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:29.565347    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:29.666798 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:29.666768    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:31.485797 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:31.485764    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:31.486174 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:31.485818    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:31.490728 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:31.490706    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:32.031149 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:32.031120    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-dc7d7c8cd-92m2v"
Sep 06 10:28:32.091037 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:32.091001    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9b6dfc968-fhdxh"]
Sep 06 10:28:32.239208 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:32.239180    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:32.341844 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:32.341759    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:32.446466 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:32.446435    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:32.541270 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:32.541234    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:36.201460 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:36.201417    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:36.262484 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:36.262458    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:41.986901 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:41.986854    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:42.089379 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:42.089346    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:45.298606 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.298571    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"]
Sep 06 10:28:45.301980 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.301959    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.304309 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.304288    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-n2fgt\""
Sep 06 10:28:45.312238 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.312216    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"]
Sep 06 10:28:45.317934 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.317911    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:45.375760 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.375738    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60de9283-9f89-4fdc-9874-73ea1fb3d134-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.375889 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.375796    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60de9283-9f89-4fdc-9874-73ea1fb3d134-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.375889 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.375864    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60de9283-9f89-4fdc-9874-73ea1fb3d134-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.375990 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.375888    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnwj8\" (UniqueName: \"kubernetes.io/projected/60de9283-9f89-4fdc-9874-73ea1fb3d134-kube-api-access-pnwj8\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.375990 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.375906    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60de9283-9f89-4fdc-9874-73ea1fb3d134-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.375990 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.375923    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60de9283-9f89-4fdc-9874-73ea1fb3d134-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.375990 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.375962    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60de9283-9f89-4fdc-9874-73ea1fb3d134-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.375990 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.375980    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60de9283-9f89-4fdc-9874-73ea1fb3d134-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.376165 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.376006    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60de9283-9f89-4fdc-9874-73ea1fb3d134-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.477260 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.477226    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60de9283-9f89-4fdc-9874-73ea1fb3d134-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.477410 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.477265    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60de9283-9f89-4fdc-9874-73ea1fb3d134-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.477410 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.477290    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60de9283-9f89-4fdc-9874-73ea1fb3d134-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.477410 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.477358    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60de9283-9f89-4fdc-9874-73ea1fb3d134-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.477517 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.477442    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60de9283-9f89-4fdc-9874-73ea1fb3d134-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.477517 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.477472    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60de9283-9f89-4fdc-9874-73ea1fb3d134-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.477732 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.477626    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnwj8\" (UniqueName: \"kubernetes.io/projected/60de9283-9f89-4fdc-9874-73ea1fb3d134-kube-api-access-pnwj8\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.477732 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.477687    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60de9283-9f89-4fdc-9874-73ea1fb3d134-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.477732 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.477719    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60de9283-9f89-4fdc-9874-73ea1fb3d134-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.477922 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.477813    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60de9283-9f89-4fdc-9874-73ea1fb3d134-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.478176 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.478154    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60de9283-9f89-4fdc-9874-73ea1fb3d134-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.478259 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.478204    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60de9283-9f89-4fdc-9874-73ea1fb3d134-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.478300 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.478263    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60de9283-9f89-4fdc-9874-73ea1fb3d134-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.478384 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.478367    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60de9283-9f89-4fdc-9874-73ea1fb3d134-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.479591 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.479571    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60de9283-9f89-4fdc-9874-73ea1fb3d134-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.479808 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.479792    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60de9283-9f89-4fdc-9874-73ea1fb3d134-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.485134 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.485108    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60de9283-9f89-4fdc-9874-73ea1fb3d134-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.485295 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.485277    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnwj8\" (UniqueName: \"kubernetes.io/projected/60de9283-9f89-4fdc-9874-73ea1fb3d134-kube-api-access-pnwj8\") pod \"maas-default-gateway-openshift-default-78bb78ff78-426bc\" (UID: \"60de9283-9f89-4fdc-9874-73ea1fb3d134\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.613361 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.613260    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:45.754802 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.754774    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:28:45.888433 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.888405    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"]
Sep 06 10:28:45.889523 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:28:45.889500    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60de9283_9f89_4fdc_9874_73ea1fb3d134.slice/crio-cd1fc3865156dcc248fca9c4b4552fb961616f1eef242cd7fe2ca2976870ff07 WatchSource:0}: Error finding container cd1fc3865156dcc248fca9c4b4552fb961616f1eef242cd7fe2ca2976870ff07: Status 404 returned error can't find the container with id cd1fc3865156dcc248fca9c4b4552fb961616f1eef242cd7fe2ca2976870ff07
Sep 06 10:28:45.891543 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.891513    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:28:45.891621 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.891577    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:28:45.891621 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:45.891603    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:28:46.110286 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:46.110247    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc" event={"ID":"60de9283-9f89-4fdc-9874-73ea1fb3d134","Type":"ContainerStarted","Data":"94fba2c6114a33045cf578c3140e58f1f9a3517f264252cd6b5b4c2487128ccc"}
Sep 06 10:28:46.110467 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:46.110370    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc" event={"ID":"60de9283-9f89-4fdc-9874-73ea1fb3d134","Type":"ContainerStarted","Data":"cd1fc3865156dcc248fca9c4b4552fb961616f1eef242cd7fe2ca2976870ff07"}
Sep 06 10:28:46.131772 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:46.131721    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc" podStartSLOduration=1.131707447 podStartE2EDuration="1.131707447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:28:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:28:46.129731779 +0000 UTC m=+417.908151191" watchObservedRunningTime="2026-09-06 10:28:46.131707447 +0000 UTC m=+417.910126860"
Sep 06 10:28:46.613603 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:46.613565    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:46.618295 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:46.618269    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:47.115558 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:47.115528    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:47.116449 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:47.116427    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:28:57.113908 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.113849    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-9b6dfc968-fhdxh" podUID="c7fe04c3-c37f-4e09-8fbb-468275ae9f78" containerName="console" containerID="cri-o://2fff22bda4afc7cd51911137ec6955f2b49b229c9042780ce3683c2c1bfd4c21" gracePeriod=15
Sep 06 10:28:57.366178 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.366122    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:28:57.486749 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.486714    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-console-serving-cert\") pod \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") "
Sep 06 10:28:57.486881 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.486775    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crl6d\" (UniqueName: \"kubernetes.io/projected/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-kube-api-access-crl6d\") pod \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") "
Sep 06 10:28:57.486940 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.486883    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-console-config\") pod \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") "
Sep 06 10:28:57.486940 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.486923    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-service-ca\") pod \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") "
Sep 06 10:28:57.487367 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.486956    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-oauth-serving-cert\") pod \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") "
Sep 06 10:28:57.487367 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.487042    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-console-oauth-config\") pod \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") "
Sep 06 10:28:57.487367 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.487067    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-trusted-ca-bundle\") pod \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\" (UID: \"c7fe04c3-c37f-4e09-8fbb-468275ae9f78\") "
Sep 06 10:28:57.487367 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.487214    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-console-config" (OuterVolumeSpecName: "console-config") pod "c7fe04c3-c37f-4e09-8fbb-468275ae9f78" (UID: "c7fe04c3-c37f-4e09-8fbb-468275ae9f78"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:28:57.487620 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.487380    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-service-ca" (OuterVolumeSpecName: "service-ca") pod "c7fe04c3-c37f-4e09-8fbb-468275ae9f78" (UID: "c7fe04c3-c37f-4e09-8fbb-468275ae9f78"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:28:57.487620 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.487434    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-console-config\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:28:57.487620 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.487519    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c7fe04c3-c37f-4e09-8fbb-468275ae9f78" (UID: "c7fe04c3-c37f-4e09-8fbb-468275ae9f78"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:28:57.487737 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.487621    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c7fe04c3-c37f-4e09-8fbb-468275ae9f78" (UID: "c7fe04c3-c37f-4e09-8fbb-468275ae9f78"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:28:57.488985 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.488961    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c7fe04c3-c37f-4e09-8fbb-468275ae9f78" (UID: "c7fe04c3-c37f-4e09-8fbb-468275ae9f78"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 10:28:57.489093 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.489021    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-kube-api-access-crl6d" (OuterVolumeSpecName: "kube-api-access-crl6d") pod "c7fe04c3-c37f-4e09-8fbb-468275ae9f78" (UID: "c7fe04c3-c37f-4e09-8fbb-468275ae9f78"). InnerVolumeSpecName "kube-api-access-crl6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:28:57.489142 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.489127    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c7fe04c3-c37f-4e09-8fbb-468275ae9f78" (UID: "c7fe04c3-c37f-4e09-8fbb-468275ae9f78"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 10:28:57.588437 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.588404    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-console-oauth-config\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:28:57.588437 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.588429    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-trusted-ca-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:28:57.588437 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.588440    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-console-serving-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:28:57.588659 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.588451    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crl6d\" (UniqueName: \"kubernetes.io/projected/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-kube-api-access-crl6d\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:28:57.588659 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.588459    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:28:57.588659 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:57.588467    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7fe04c3-c37f-4e09-8fbb-468275ae9f78-oauth-serving-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:28:58.173532 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:58.173498    2561 generic.go:356] "Generic (PLEG): container finished" podID="c7fe04c3-c37f-4e09-8fbb-468275ae9f78" containerID="2fff22bda4afc7cd51911137ec6955f2b49b229c9042780ce3683c2c1bfd4c21" exitCode=0
Sep 06 10:28:58.173933 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:58.173542    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9b6dfc968-fhdxh"
Sep 06 10:28:58.173933 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:58.173581    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b6dfc968-fhdxh" event={"ID":"c7fe04c3-c37f-4e09-8fbb-468275ae9f78","Type":"ContainerDied","Data":"2fff22bda4afc7cd51911137ec6955f2b49b229c9042780ce3683c2c1bfd4c21"}
Sep 06 10:28:58.173933 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:58.173636    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9b6dfc968-fhdxh" event={"ID":"c7fe04c3-c37f-4e09-8fbb-468275ae9f78","Type":"ContainerDied","Data":"10f99b1e85b42fede329a20d9a48561e52259cb52551617482357222ea0e470d"}
Sep 06 10:28:58.173933 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:58.173656    2561 scope.go:117] "RemoveContainer" containerID="2fff22bda4afc7cd51911137ec6955f2b49b229c9042780ce3683c2c1bfd4c21"
Sep 06 10:28:58.182737 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:58.182722    2561 scope.go:117] "RemoveContainer" containerID="2fff22bda4afc7cd51911137ec6955f2b49b229c9042780ce3683c2c1bfd4c21"
Sep 06 10:28:58.183007 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:28:58.182988    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fff22bda4afc7cd51911137ec6955f2b49b229c9042780ce3683c2c1bfd4c21\": container with ID starting with 2fff22bda4afc7cd51911137ec6955f2b49b229c9042780ce3683c2c1bfd4c21 not found: ID does not exist" containerID="2fff22bda4afc7cd51911137ec6955f2b49b229c9042780ce3683c2c1bfd4c21"
Sep 06 10:28:58.183051 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:58.183015    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fff22bda4afc7cd51911137ec6955f2b49b229c9042780ce3683c2c1bfd4c21"} err="failed to get container status \"2fff22bda4afc7cd51911137ec6955f2b49b229c9042780ce3683c2c1bfd4c21\": rpc error: code = NotFound desc = could not find container \"2fff22bda4afc7cd51911137ec6955f2b49b229c9042780ce3683c2c1bfd4c21\": container with ID starting with 2fff22bda4afc7cd51911137ec6955f2b49b229c9042780ce3683c2c1bfd4c21 not found: ID does not exist"
Sep 06 10:28:58.195661 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:58.195640    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9b6dfc968-fhdxh"]
Sep 06 10:28:58.201196 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:58.201177    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9b6dfc968-fhdxh"]
Sep 06 10:28:58.754482 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:28:58.754448    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7fe04c3-c37f-4e09-8fbb-468275ae9f78" path="/var/lib/kubelet/pods/c7fe04c3-c37f-4e09-8fbb-468275ae9f78/volumes"
Sep 06 10:29:02.391021 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:02.390973    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:29:02.530733 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:02.530698    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:29:02.605234 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:02.605197    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:29:03.208303 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:03.208269    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-lzjll"]
Sep 06 10:29:03.208673 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:03.208658    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7fe04c3-c37f-4e09-8fbb-468275ae9f78" containerName="console"
Sep 06 10:29:03.208726 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:03.208674    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7fe04c3-c37f-4e09-8fbb-468275ae9f78" containerName="console"
Sep 06 10:29:03.208762 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:03.208745    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7fe04c3-c37f-4e09-8fbb-468275ae9f78" containerName="console"
Sep 06 10:29:03.211937 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:03.211920    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-lzjll"
Sep 06 10:29:03.214235 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:03.214214    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-42x92\""
Sep 06 10:29:03.219446 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:03.219419    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-lzjll"]
Sep 06 10:29:03.242822 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:03.242801    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:29:03.336572 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:03.336537    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrmhz\" (UniqueName: \"kubernetes.io/projected/a7d27748-5ddf-4179-9bb2-17d9e9f4a314-kube-api-access-vrmhz\") pod \"authorino-b54df94b4-lzjll\" (UID: \"a7d27748-5ddf-4179-9bb2-17d9e9f4a314\") " pod="kuadrant-system/authorino-b54df94b4-lzjll"
Sep 06 10:29:03.343576 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:03.343547    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:29:03.437891 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:03.437861    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrmhz\" (UniqueName: \"kubernetes.io/projected/a7d27748-5ddf-4179-9bb2-17d9e9f4a314-kube-api-access-vrmhz\") pod \"authorino-b54df94b4-lzjll\" (UID: \"a7d27748-5ddf-4179-9bb2-17d9e9f4a314\") " pod="kuadrant-system/authorino-b54df94b4-lzjll"
Sep 06 10:29:03.445674 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:03.445646    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrmhz\" (UniqueName: \"kubernetes.io/projected/a7d27748-5ddf-4179-9bb2-17d9e9f4a314-kube-api-access-vrmhz\") pod \"authorino-b54df94b4-lzjll\" (UID: \"a7d27748-5ddf-4179-9bb2-17d9e9f4a314\") " pod="kuadrant-system/authorino-b54df94b4-lzjll"
Sep 06 10:29:03.522240 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:03.522162    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-lzjll"
Sep 06 10:29:03.789552 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:03.789520    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-lzjll"]
Sep 06 10:29:03.791061 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:29:03.791036    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7d27748_5ddf_4179_9bb2_17d9e9f4a314.slice/crio-ab87c92d1ca0058a1bb5919920c54052bf54ed4fb9e11890f0c3dbd2c651d55d WatchSource:0}: Error finding container ab87c92d1ca0058a1bb5919920c54052bf54ed4fb9e11890f0c3dbd2c651d55d: Status 404 returned error can't find the container with id ab87c92d1ca0058a1bb5919920c54052bf54ed4fb9e11890f0c3dbd2c651d55d
Sep 06 10:29:04.207291 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:04.207247    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-lzjll" event={"ID":"a7d27748-5ddf-4179-9bb2-17d9e9f4a314","Type":"ContainerStarted","Data":"ab87c92d1ca0058a1bb5919920c54052bf54ed4fb9e11890f0c3dbd2c651d55d"}
Sep 06 10:29:06.103389 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:06.103349    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-lzjll"]
Sep 06 10:29:06.220385 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:06.220347    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-lzjll" event={"ID":"a7d27748-5ddf-4179-9bb2-17d9e9f4a314","Type":"ContainerStarted","Data":"904ca73de0ec2b5642f030a8680f02a9c402fcf5cd00cb68c52966cde301fec5"}
Sep 06 10:29:06.235803 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:06.235745    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-lzjll" podStartSLOduration=1.456606753 podStartE2EDuration="3.235723423s" totalImagesPullingTime="1.77911667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:29:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:29:06.234036148 +0000 UTC m=+438.012455562" watchObservedRunningTime="2026-09-06 10:29:06.235723423 +0000 UTC m=+438.014142836"
Sep 06 10:29:07.225988 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:07.225951    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-lzjll" podUID="a7d27748-5ddf-4179-9bb2-17d9e9f4a314" containerName="authorino" containerID="cri-o://904ca73de0ec2b5642f030a8680f02a9c402fcf5cd00cb68c52966cde301fec5" gracePeriod=30
Sep 06 10:29:07.479808 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:07.479752    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-lzjll"
Sep 06 10:29:07.676449 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:07.676414    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrmhz\" (UniqueName: \"kubernetes.io/projected/a7d27748-5ddf-4179-9bb2-17d9e9f4a314-kube-api-access-vrmhz\") pod \"a7d27748-5ddf-4179-9bb2-17d9e9f4a314\" (UID: \"a7d27748-5ddf-4179-9bb2-17d9e9f4a314\") "
Sep 06 10:29:07.678607 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:07.678574    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7d27748-5ddf-4179-9bb2-17d9e9f4a314-kube-api-access-vrmhz" (OuterVolumeSpecName: "kube-api-access-vrmhz") pod "a7d27748-5ddf-4179-9bb2-17d9e9f4a314" (UID: "a7d27748-5ddf-4179-9bb2-17d9e9f4a314"). InnerVolumeSpecName "kube-api-access-vrmhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:29:07.777516 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:07.777437    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrmhz\" (UniqueName: \"kubernetes.io/projected/a7d27748-5ddf-4179-9bb2-17d9e9f4a314-kube-api-access-vrmhz\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:29:08.232764 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:08.232726    2561 generic.go:356] "Generic (PLEG): container finished" podID="a7d27748-5ddf-4179-9bb2-17d9e9f4a314" containerID="904ca73de0ec2b5642f030a8680f02a9c402fcf5cd00cb68c52966cde301fec5" exitCode=0
Sep 06 10:29:08.233213 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:08.232778    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-lzjll"
Sep 06 10:29:08.233213 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:08.232795    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-lzjll" event={"ID":"a7d27748-5ddf-4179-9bb2-17d9e9f4a314","Type":"ContainerDied","Data":"904ca73de0ec2b5642f030a8680f02a9c402fcf5cd00cb68c52966cde301fec5"}
Sep 06 10:29:08.233213 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:08.232836    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-lzjll" event={"ID":"a7d27748-5ddf-4179-9bb2-17d9e9f4a314","Type":"ContainerDied","Data":"ab87c92d1ca0058a1bb5919920c54052bf54ed4fb9e11890f0c3dbd2c651d55d"}
Sep 06 10:29:08.233213 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:08.232861    2561 scope.go:117] "RemoveContainer" containerID="904ca73de0ec2b5642f030a8680f02a9c402fcf5cd00cb68c52966cde301fec5"
Sep 06 10:29:08.242487 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:08.242470    2561 scope.go:117] "RemoveContainer" containerID="904ca73de0ec2b5642f030a8680f02a9c402fcf5cd00cb68c52966cde301fec5"
Sep 06 10:29:08.242744 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:29:08.242724    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"904ca73de0ec2b5642f030a8680f02a9c402fcf5cd00cb68c52966cde301fec5\": container with ID starting with 904ca73de0ec2b5642f030a8680f02a9c402fcf5cd00cb68c52966cde301fec5 not found: ID does not exist" containerID="904ca73de0ec2b5642f030a8680f02a9c402fcf5cd00cb68c52966cde301fec5"
Sep 06 10:29:08.242819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:08.242752    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"904ca73de0ec2b5642f030a8680f02a9c402fcf5cd00cb68c52966cde301fec5"} err="failed to get container status \"904ca73de0ec2b5642f030a8680f02a9c402fcf5cd00cb68c52966cde301fec5\": rpc error: code = NotFound desc = could not find container \"904ca73de0ec2b5642f030a8680f02a9c402fcf5cd00cb68c52966cde301fec5\": container with ID starting with 904ca73de0ec2b5642f030a8680f02a9c402fcf5cd00cb68c52966cde301fec5 not found: ID does not exist"
Sep 06 10:29:08.253090 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:08.253064    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-lzjll"]
Sep 06 10:29:08.257783 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:08.257764    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-lzjll"]
Sep 06 10:29:08.755207 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:08.755175    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7d27748-5ddf-4179-9bb2-17d9e9f4a314" path="/var/lib/kubelet/pods/a7d27748-5ddf-4179-9bb2-17d9e9f4a314/volumes"
Sep 06 10:29:18.604268 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:18.604174    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:29:18.721786 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:18.721739    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:29:19.064714 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:19.064665    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qsvmz"]
Sep 06 10:29:19.065092 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:19.065072    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7d27748-5ddf-4179-9bb2-17d9e9f4a314" containerName="authorino"
Sep 06 10:29:19.065092 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:19.065091    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7d27748-5ddf-4179-9bb2-17d9e9f4a314" containerName="authorino"
Sep 06 10:29:19.065222 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:19.065151    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7d27748-5ddf-4179-9bb2-17d9e9f4a314" containerName="authorino"
Sep 06 10:29:19.068187 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:19.068169    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsvmz"
Sep 06 10:29:19.070805 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:19.070781    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 06 10:29:19.070949 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:19.070826    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 06 10:29:19.070949 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:19.070807    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-slzjg\""
Sep 06 10:29:19.071407 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:19.071388    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 10:29:19.075203 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:19.075171    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qsvmz"]
Sep 06 10:29:19.090539 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:19.090499    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:29:19.171888 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:19.171853    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d659269b-568b-4713-8bc2-10f50642a01c-data\") pod \"postgres-69fb4594cf-qsvmz\" (UID: \"d659269b-568b-4713-8bc2-10f50642a01c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsvmz"
Sep 06 10:29:19.172059 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:19.171914    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2zhn\" (UniqueName: \"kubernetes.io/projected/d659269b-568b-4713-8bc2-10f50642a01c-kube-api-access-z2zhn\") pod \"postgres-69fb4594cf-qsvmz\" (UID: \"d659269b-568b-4713-8bc2-10f50642a01c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsvmz"
Sep 06 10:29:19.272511 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:19.272476    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d659269b-568b-4713-8bc2-10f50642a01c-data\") pod \"postgres-69fb4594cf-qsvmz\" (UID: \"d659269b-568b-4713-8bc2-10f50642a01c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsvmz"
Sep 06 10:29:19.272511 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:19.272514    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2zhn\" (UniqueName: \"kubernetes.io/projected/d659269b-568b-4713-8bc2-10f50642a01c-kube-api-access-z2zhn\") pod \"postgres-69fb4594cf-qsvmz\" (UID: \"d659269b-568b-4713-8bc2-10f50642a01c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsvmz"
Sep 06 10:29:19.272930 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:19.272910    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d659269b-568b-4713-8bc2-10f50642a01c-data\") pod \"postgres-69fb4594cf-qsvmz\" (UID: \"d659269b-568b-4713-8bc2-10f50642a01c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsvmz"
Sep 06 10:29:19.280289 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:19.280254    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2zhn\" (UniqueName: \"kubernetes.io/projected/d659269b-568b-4713-8bc2-10f50642a01c-kube-api-access-z2zhn\") pod \"postgres-69fb4594cf-qsvmz\" (UID: \"d659269b-568b-4713-8bc2-10f50642a01c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsvmz"
Sep 06 10:29:19.380383 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:19.380271    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsvmz"
Sep 06 10:29:19.648773 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:19.648746    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qsvmz"]
Sep 06 10:29:19.650008 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:29:19.649977    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd659269b_568b_4713_8bc2_10f50642a01c.slice/crio-d758e48b8066c6e14f37a445c84a12ba7a6c4ab237dfb9064e0f65858983eeb7 WatchSource:0}: Error finding container d758e48b8066c6e14f37a445c84a12ba7a6c4ab237dfb9064e0f65858983eeb7: Status 404 returned error can't find the container with id d758e48b8066c6e14f37a445c84a12ba7a6c4ab237dfb9064e0f65858983eeb7
Sep 06 10:29:20.298932 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:20.298897    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsvmz" event={"ID":"d659269b-568b-4713-8bc2-10f50642a01c","Type":"ContainerStarted","Data":"d758e48b8066c6e14f37a445c84a12ba7a6c4ab237dfb9064e0f65858983eeb7"}
Sep 06 10:29:25.330464 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:25.330429    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsvmz" event={"ID":"d659269b-568b-4713-8bc2-10f50642a01c","Type":"ContainerStarted","Data":"68f5814440b8999389f88189db250a2c8f57d2ca23fa2db0a62270195246a898"}
Sep 06 10:29:25.330836 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:25.330495    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsvmz"
Sep 06 10:29:25.346248 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:25.346196    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsvmz" podStartSLOduration=1.634700269 podStartE2EDuration="6.346181577s" totalImagesPullingTime="4.711481308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:29:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:29:25.344887945 +0000 UTC m=+457.123307358" watchObservedRunningTime="2026-09-06 10:29:25.346181577 +0000 UTC m=+457.124600990"
Sep 06 10:29:31.365363 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:31.365311    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qsvmz"
Sep 06 10:29:31.684442 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:31.684413    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:29:31.916361 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:31.916312    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-j2d45"]
Sep 06 10:29:31.928115 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:31.928072    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-j2d45"]
Sep 06 10:29:31.928298 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:31.928194    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-j2d45"
Sep 06 10:29:31.930519 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:31.930492    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-42x92\""
Sep 06 10:29:31.985720 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:31.985690    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l5zc\" (UniqueName: \"kubernetes.io/projected/ac2149cc-f5fb-4527-8515-db09802c41a6-kube-api-access-9l5zc\") pod \"authorino-5dc7ccb5f-j2d45\" (UID: \"ac2149cc-f5fb-4527-8515-db09802c41a6\") " pod="kuadrant-system/authorino-5dc7ccb5f-j2d45"
Sep 06 10:29:32.086590 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:32.086555    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l5zc\" (UniqueName: \"kubernetes.io/projected/ac2149cc-f5fb-4527-8515-db09802c41a6-kube-api-access-9l5zc\") pod \"authorino-5dc7ccb5f-j2d45\" (UID: \"ac2149cc-f5fb-4527-8515-db09802c41a6\") " pod="kuadrant-system/authorino-5dc7ccb5f-j2d45"
Sep 06 10:29:32.094549 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:32.094520    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l5zc\" (UniqueName: \"kubernetes.io/projected/ac2149cc-f5fb-4527-8515-db09802c41a6-kube-api-access-9l5zc\") pod \"authorino-5dc7ccb5f-j2d45\" (UID: \"ac2149cc-f5fb-4527-8515-db09802c41a6\") " pod="kuadrant-system/authorino-5dc7ccb5f-j2d45"
Sep 06 10:29:32.156477 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:32.156446    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-j2d45"]
Sep 06 10:29:32.156723 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:32.156710    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-j2d45"
Sep 06 10:29:32.188947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:32.188889    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86ff46fd4-8999m"]
Sep 06 10:29:32.197387 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:32.197362    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86ff46fd4-8999m"
Sep 06 10:29:32.199414 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:32.199383    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86ff46fd4-8999m"]
Sep 06 10:29:32.288553 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:32.288515    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4c28h\" (UniqueName: \"kubernetes.io/projected/7b1ca4a8-6e38-4a2a-973d-ff847481e82c-kube-api-access-4c28h\") pod \"authorino-86ff46fd4-8999m\" (UID: \"7b1ca4a8-6e38-4a2a-973d-ff847481e82c\") " pod="kuadrant-system/authorino-86ff46fd4-8999m"
Sep 06 10:29:32.307436 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:32.307404    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:29:32.389606 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:32.389569    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4c28h\" (UniqueName: \"kubernetes.io/projected/7b1ca4a8-6e38-4a2a-973d-ff847481e82c-kube-api-access-4c28h\") pod \"authorino-86ff46fd4-8999m\" (UID: \"7b1ca4a8-6e38-4a2a-973d-ff847481e82c\") " pod="kuadrant-system/authorino-86ff46fd4-8999m"
Sep 06 10:29:32.399029 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:32.399006    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4c28h\" (UniqueName: \"kubernetes.io/projected/7b1ca4a8-6e38-4a2a-973d-ff847481e82c-kube-api-access-4c28h\") pod \"authorino-86ff46fd4-8999m\" (UID: \"7b1ca4a8-6e38-4a2a-973d-ff847481e82c\") " pod="kuadrant-system/authorino-86ff46fd4-8999m"
Sep 06 10:29:32.445553 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:32.445527    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-j2d45"]
Sep 06 10:29:32.446893 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:29:32.446856    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac2149cc_f5fb_4527_8515_db09802c41a6.slice/crio-ab15bccde662d571e22636a298709f0ae568fb69a584172434597e720d6b362b WatchSource:0}: Error finding container ab15bccde662d571e22636a298709f0ae568fb69a584172434597e720d6b362b: Status 404 returned error can't find the container with id ab15bccde662d571e22636a298709f0ae568fb69a584172434597e720d6b362b
Sep 06 10:29:32.509838 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:32.509807    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86ff46fd4-8999m"
Sep 06 10:29:32.800266 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:32.800242    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86ff46fd4-8999m"]
Sep 06 10:29:32.802026 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:29:32.801996    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b1ca4a8_6e38_4a2a_973d_ff847481e82c.slice/crio-eacbc0e89f157dd824b227c65180c66e207c37b1c8424d70193eeb6fb18ee6c4 WatchSource:0}: Error finding container eacbc0e89f157dd824b227c65180c66e207c37b1c8424d70193eeb6fb18ee6c4: Status 404 returned error can't find the container with id eacbc0e89f157dd824b227c65180c66e207c37b1c8424d70193eeb6fb18ee6c4
Sep 06 10:29:33.375294 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:33.375254    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-j2d45" event={"ID":"ac2149cc-f5fb-4527-8515-db09802c41a6","Type":"ContainerStarted","Data":"e31e0dc3cf83f6d0c9f92f8a90b74f2b807fd859a18cd4e09692743d7710cccd"}
Sep 06 10:29:33.375475 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:33.375305    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-j2d45" event={"ID":"ac2149cc-f5fb-4527-8515-db09802c41a6","Type":"ContainerStarted","Data":"ab15bccde662d571e22636a298709f0ae568fb69a584172434597e720d6b362b"}
Sep 06 10:29:33.375475 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:33.375304    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5dc7ccb5f-j2d45" podUID="ac2149cc-f5fb-4527-8515-db09802c41a6" containerName="authorino" containerID="cri-o://e31e0dc3cf83f6d0c9f92f8a90b74f2b807fd859a18cd4e09692743d7710cccd" gracePeriod=30
Sep 06 10:29:33.376595 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:33.376569    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86ff46fd4-8999m" event={"ID":"7b1ca4a8-6e38-4a2a-973d-ff847481e82c","Type":"ContainerStarted","Data":"eacbc0e89f157dd824b227c65180c66e207c37b1c8424d70193eeb6fb18ee6c4"}
Sep 06 10:29:33.390894 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:33.390818    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dc7ccb5f-j2d45" podStartSLOduration=1.702979672 podStartE2EDuration="2.390804381s" totalImagesPullingTime="687.824709ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:29:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:29:33.388675988 +0000 UTC m=+465.167095400" watchObservedRunningTime="2026-09-06 10:29:33.390804381 +0000 UTC m=+465.169223814"
Sep 06 10:29:33.681234 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:33.681205    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-j2d45"
Sep 06 10:29:33.804308 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:33.804276    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9l5zc\" (UniqueName: \"kubernetes.io/projected/ac2149cc-f5fb-4527-8515-db09802c41a6-kube-api-access-9l5zc\") pod \"ac2149cc-f5fb-4527-8515-db09802c41a6\" (UID: \"ac2149cc-f5fb-4527-8515-db09802c41a6\") "
Sep 06 10:29:33.806725 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:33.806701    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac2149cc-f5fb-4527-8515-db09802c41a6-kube-api-access-9l5zc" (OuterVolumeSpecName: "kube-api-access-9l5zc") pod "ac2149cc-f5fb-4527-8515-db09802c41a6" (UID: "ac2149cc-f5fb-4527-8515-db09802c41a6"). InnerVolumeSpecName "kube-api-access-9l5zc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:29:33.905403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:33.905379    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9l5zc\" (UniqueName: \"kubernetes.io/projected/ac2149cc-f5fb-4527-8515-db09802c41a6-kube-api-access-9l5zc\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:29:34.384418 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:34.384308    2561 generic.go:356] "Generic (PLEG): container finished" podID="ac2149cc-f5fb-4527-8515-db09802c41a6" containerID="e31e0dc3cf83f6d0c9f92f8a90b74f2b807fd859a18cd4e09692743d7710cccd" exitCode=0
Sep 06 10:29:34.384418 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:34.384365    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-j2d45"
Sep 06 10:29:34.384418 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:34.384399    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-j2d45" event={"ID":"ac2149cc-f5fb-4527-8515-db09802c41a6","Type":"ContainerDied","Data":"e31e0dc3cf83f6d0c9f92f8a90b74f2b807fd859a18cd4e09692743d7710cccd"}
Sep 06 10:29:34.384699 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:34.384435    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-j2d45" event={"ID":"ac2149cc-f5fb-4527-8515-db09802c41a6","Type":"ContainerDied","Data":"ab15bccde662d571e22636a298709f0ae568fb69a584172434597e720d6b362b"}
Sep 06 10:29:34.384699 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:34.384454    2561 scope.go:117] "RemoveContainer" containerID="e31e0dc3cf83f6d0c9f92f8a90b74f2b807fd859a18cd4e09692743d7710cccd"
Sep 06 10:29:34.385960 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:34.385933    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86ff46fd4-8999m" event={"ID":"7b1ca4a8-6e38-4a2a-973d-ff847481e82c","Type":"ContainerStarted","Data":"1972be86de702cb290ac2e93ec3837d2846425888703855075be12ab2be3a7c1"}
Sep 06 10:29:34.393670 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:34.393655    2561 scope.go:117] "RemoveContainer" containerID="e31e0dc3cf83f6d0c9f92f8a90b74f2b807fd859a18cd4e09692743d7710cccd"
Sep 06 10:29:34.393934 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:29:34.393917    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e31e0dc3cf83f6d0c9f92f8a90b74f2b807fd859a18cd4e09692743d7710cccd\": container with ID starting with e31e0dc3cf83f6d0c9f92f8a90b74f2b807fd859a18cd4e09692743d7710cccd not found: ID does not exist" containerID="e31e0dc3cf83f6d0c9f92f8a90b74f2b807fd859a18cd4e09692743d7710cccd"
Sep 06 10:29:34.393977 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:34.393943    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e31e0dc3cf83f6d0c9f92f8a90b74f2b807fd859a18cd4e09692743d7710cccd"} err="failed to get container status \"e31e0dc3cf83f6d0c9f92f8a90b74f2b807fd859a18cd4e09692743d7710cccd\": rpc error: code = NotFound desc = could not find container \"e31e0dc3cf83f6d0c9f92f8a90b74f2b807fd859a18cd4e09692743d7710cccd\": container with ID starting with e31e0dc3cf83f6d0c9f92f8a90b74f2b807fd859a18cd4e09692743d7710cccd not found: ID does not exist"
Sep 06 10:29:34.402258 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:34.402221    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-86ff46fd4-8999m" podStartSLOduration=1.770956202 podStartE2EDuration="2.40220875s" totalImagesPullingTime="631.252548ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:29:34.400879737 +0000 UTC m=+466.179299151" watchObservedRunningTime="2026-09-06 10:29:34.40220875 +0000 UTC m=+466.180628162"
Sep 06 10:29:34.416134 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:34.416108    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-j2d45"]
Sep 06 10:29:34.425381 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:34.425357    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-j2d45"]
Sep 06 10:29:34.754170 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:34.754134    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac2149cc-f5fb-4527-8515-db09802c41a6" path="/var/lib/kubelet/pods/ac2149cc-f5fb-4527-8515-db09802c41a6/volumes"
Sep 06 10:29:36.246972 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:36.246939    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86ff46fd4-8999m"]
Sep 06 10:29:36.397852 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:36.397813    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-86ff46fd4-8999m" podUID="7b1ca4a8-6e38-4a2a-973d-ff847481e82c" containerName="authorino" containerID="cri-o://1972be86de702cb290ac2e93ec3837d2846425888703855075be12ab2be3a7c1" gracePeriod=30
Sep 06 10:29:36.646857 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:36.646833    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86ff46fd4-8999m"
Sep 06 10:29:36.727048 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:36.726995    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4c28h\" (UniqueName: \"kubernetes.io/projected/7b1ca4a8-6e38-4a2a-973d-ff847481e82c-kube-api-access-4c28h\") pod \"7b1ca4a8-6e38-4a2a-973d-ff847481e82c\" (UID: \"7b1ca4a8-6e38-4a2a-973d-ff847481e82c\") "
Sep 06 10:29:36.729166 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:36.729142    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b1ca4a8-6e38-4a2a-973d-ff847481e82c-kube-api-access-4c28h" (OuterVolumeSpecName: "kube-api-access-4c28h") pod "7b1ca4a8-6e38-4a2a-973d-ff847481e82c" (UID: "7b1ca4a8-6e38-4a2a-973d-ff847481e82c"). InnerVolumeSpecName "kube-api-access-4c28h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:29:36.828018 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:36.827920    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4c28h\" (UniqueName: \"kubernetes.io/projected/7b1ca4a8-6e38-4a2a-973d-ff847481e82c-kube-api-access-4c28h\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:29:37.404229 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:37.404192    2561 generic.go:356] "Generic (PLEG): container finished" podID="7b1ca4a8-6e38-4a2a-973d-ff847481e82c" containerID="1972be86de702cb290ac2e93ec3837d2846425888703855075be12ab2be3a7c1" exitCode=0
Sep 06 10:29:37.404657 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:37.404247    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86ff46fd4-8999m"
Sep 06 10:29:37.404657 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:37.404279    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86ff46fd4-8999m" event={"ID":"7b1ca4a8-6e38-4a2a-973d-ff847481e82c","Type":"ContainerDied","Data":"1972be86de702cb290ac2e93ec3837d2846425888703855075be12ab2be3a7c1"}
Sep 06 10:29:37.404657 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:37.404342    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-86ff46fd4-8999m" event={"ID":"7b1ca4a8-6e38-4a2a-973d-ff847481e82c","Type":"ContainerDied","Data":"eacbc0e89f157dd824b227c65180c66e207c37b1c8424d70193eeb6fb18ee6c4"}
Sep 06 10:29:37.404657 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:37.404365    2561 scope.go:117] "RemoveContainer" containerID="1972be86de702cb290ac2e93ec3837d2846425888703855075be12ab2be3a7c1"
Sep 06 10:29:37.413180 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:37.413161    2561 scope.go:117] "RemoveContainer" containerID="1972be86de702cb290ac2e93ec3837d2846425888703855075be12ab2be3a7c1"
Sep 06 10:29:37.413482 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:29:37.413460    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1972be86de702cb290ac2e93ec3837d2846425888703855075be12ab2be3a7c1\": container with ID starting with 1972be86de702cb290ac2e93ec3837d2846425888703855075be12ab2be3a7c1 not found: ID does not exist" containerID="1972be86de702cb290ac2e93ec3837d2846425888703855075be12ab2be3a7c1"
Sep 06 10:29:37.413536 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:37.413498    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1972be86de702cb290ac2e93ec3837d2846425888703855075be12ab2be3a7c1"} err="failed to get container status \"1972be86de702cb290ac2e93ec3837d2846425888703855075be12ab2be3a7c1\": rpc error: code = NotFound desc = could not find container \"1972be86de702cb290ac2e93ec3837d2846425888703855075be12ab2be3a7c1\": container with ID starting with 1972be86de702cb290ac2e93ec3837d2846425888703855075be12ab2be3a7c1 not found: ID does not exist"
Sep 06 10:29:37.422297 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:37.422274    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86ff46fd4-8999m"]
Sep 06 10:29:37.425778 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:37.425756    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-86ff46fd4-8999m"]
Sep 06 10:29:37.459106 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:37.459084    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:29:38.757892 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:38.757860    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b1ca4a8-6e38-4a2a-973d-ff847481e82c" path="/var/lib/kubelet/pods/7b1ca4a8-6e38-4a2a-973d-ff847481e82c/volumes"
Sep 06 10:29:39.116460 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:39.116379    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:29:39.214838 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:39.214810    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:29:39.270875 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:39.270836    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:29:39.485990 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:39.485953    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:29:39.625469 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:39.625433    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:29:42.810176 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:42.810143    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:29:42.932254 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:42.932220    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:29:43.235842 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:29:43.235800    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:30:14.888462 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:14.888429    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:30:15.208432 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:15.208403    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:30:15.309480 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:15.309449    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:30:16.724217 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:16.724182    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:30:16.824483 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:16.824454    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:30:16.916951 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:16.916920    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:30:17.106396 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.106314    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:30:17.251071 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.251040    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:30:17.367241 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.367160    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:30:17.569346 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.569289    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-gsbqz"]
Sep 06 10:30:17.569748 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.569730    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1ca4a8-6e38-4a2a-973d-ff847481e82c" containerName="authorino"
Sep 06 10:30:17.569748 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.569749    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1ca4a8-6e38-4a2a-973d-ff847481e82c" containerName="authorino"
Sep 06 10:30:17.569905 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.569771    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac2149cc-f5fb-4527-8515-db09802c41a6" containerName="authorino"
Sep 06 10:30:17.569905 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.569781    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac2149cc-f5fb-4527-8515-db09802c41a6" containerName="authorino"
Sep 06 10:30:17.569905 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.569860    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac2149cc-f5fb-4527-8515-db09802c41a6" containerName="authorino"
Sep 06 10:30:17.569905 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.569872    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b1ca4a8-6e38-4a2a-973d-ff847481e82c" containerName="authorino"
Sep 06 10:30:17.572952 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.572932    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-gsbqz"
Sep 06 10:30:17.575251 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.575230    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 06 10:30:17.575515 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.575490    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-94hsd\""
Sep 06 10:30:17.586758 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.586735    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-gsbqz"]
Sep 06 10:30:17.709306 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.709263    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da70f3cc-515f-40f9-83fe-ac247b59d6c2-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-gsbqz\" (UID: \"da70f3cc-515f-40f9-83fe-ac247b59d6c2\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-gsbqz"
Sep 06 10:30:17.709526 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.709372    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m8xr\" (UniqueName: \"kubernetes.io/projected/da70f3cc-515f-40f9-83fe-ac247b59d6c2-kube-api-access-9m8xr\") pod \"payload-processing-5b54b7fbb7-gsbqz\" (UID: \"da70f3cc-515f-40f9-83fe-ac247b59d6c2\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-gsbqz"
Sep 06 10:30:17.810237 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.810191    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da70f3cc-515f-40f9-83fe-ac247b59d6c2-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-gsbqz\" (UID: \"da70f3cc-515f-40f9-83fe-ac247b59d6c2\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-gsbqz"
Sep 06 10:30:17.810726 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.810257    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8xr\" (UniqueName: \"kubernetes.io/projected/da70f3cc-515f-40f9-83fe-ac247b59d6c2-kube-api-access-9m8xr\") pod \"payload-processing-5b54b7fbb7-gsbqz\" (UID: \"da70f3cc-515f-40f9-83fe-ac247b59d6c2\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-gsbqz"
Sep 06 10:30:17.810947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.810926    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/da70f3cc-515f-40f9-83fe-ac247b59d6c2-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-gsbqz\" (UID: \"da70f3cc-515f-40f9-83fe-ac247b59d6c2\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-gsbqz"
Sep 06 10:30:17.818729 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.818704    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m8xr\" (UniqueName: \"kubernetes.io/projected/da70f3cc-515f-40f9-83fe-ac247b59d6c2-kube-api-access-9m8xr\") pod \"payload-processing-5b54b7fbb7-gsbqz\" (UID: \"da70f3cc-515f-40f9-83fe-ac247b59d6c2\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-gsbqz"
Sep 06 10:30:17.887858 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:17.887821    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-gsbqz"
Sep 06 10:30:18.177618 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:18.177584    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-gsbqz"]
Sep 06 10:30:18.178945 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:30:18.178906    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda70f3cc_515f_40f9_83fe_ac247b59d6c2.slice/crio-4702d37b5988527853bfa94025245157aa53403c7cce09845351b50846a5c64b WatchSource:0}: Error finding container 4702d37b5988527853bfa94025245157aa53403c7cce09845351b50846a5c64b: Status 404 returned error can't find the container with id 4702d37b5988527853bfa94025245157aa53403c7cce09845351b50846a5c64b
Sep 06 10:30:18.630677 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:18.630640    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-gsbqz" event={"ID":"da70f3cc-515f-40f9-83fe-ac247b59d6c2","Type":"ContainerStarted","Data":"4702d37b5988527853bfa94025245157aa53403c7cce09845351b50846a5c64b"}
Sep 06 10:30:20.668166 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:20.668127    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-gsbqz" event={"ID":"da70f3cc-515f-40f9-83fe-ac247b59d6c2","Type":"ContainerStarted","Data":"d230d4ba76ced2465d084509870847249c8a34c7058290603aa22c562f9c5490"}
Sep 06 10:30:20.668574 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:20.668228    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-gsbqz"
Sep 06 10:30:20.685785 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:20.685728    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-gsbqz" podStartSLOduration=1.5748650610000001 podStartE2EDuration="3.685712201s" totalImagesPullingTime="2.11084714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:30:20.684395386 +0000 UTC m=+512.462814803" watchObservedRunningTime="2026-09-06 10:30:20.685712201 +0000 UTC m=+512.464131614"
Sep 06 10:30:26.471702 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:26.471667    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:30:26.570768 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:26.570688    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:30:26.708890 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:26.708857    2561 generic.go:356] "Generic (PLEG): container finished" podID="60de9283-9f89-4fdc-9874-73ea1fb3d134" containerID="94fba2c6114a33045cf578c3140e58f1f9a3517f264252cd6b5b4c2487128ccc" exitCode=0
Sep 06 10:30:26.709058 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:26.708931    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc" event={"ID":"60de9283-9f89-4fdc-9874-73ea1fb3d134","Type":"ContainerDied","Data":"94fba2c6114a33045cf578c3140e58f1f9a3517f264252cd6b5b4c2487128ccc"}
Sep 06 10:30:26.709370 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:26.709355    2561 scope.go:117] "RemoveContainer" containerID="94fba2c6114a33045cf578c3140e58f1f9a3517f264252cd6b5b4c2487128ccc"
Sep 06 10:30:26.710370 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:26.710343    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:30:26.710458 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:26.710407    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:30:26.710458 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:26.710443    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:30:27.717334 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:27.717286    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc" event={"ID":"60de9283-9f89-4fdc-9874-73ea1fb3d134","Type":"ContainerStarted","Data":"3a53ffa1ecd23c26f8117f81b99a72dde5512c10e93e943e515318b6fde8543b"}
Sep 06 10:30:28.613709 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:28.613674    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:30:28.614896 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:28.614866    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-426bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 06 10:30:28.615034 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:28.614915    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc" podUID="60de9283-9f89-4fdc-9874-73ea1fb3d134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 06 10:30:29.613929 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:29.613886    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-426bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 06 10:30:29.614306 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:29.613980    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc" podUID="60de9283-9f89-4fdc-9874-73ea1fb3d134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 06 10:30:30.614008 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:30.613974    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-426bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 06 10:30:30.614407 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:30.614028    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc" podUID="60de9283-9f89-4fdc-9874-73ea1fb3d134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 06 10:30:31.614395 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:31.614356    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-426bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 06 10:30:31.614792 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:31.614420    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc" podUID="60de9283-9f89-4fdc-9874-73ea1fb3d134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 06 10:30:31.676435 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:31.676402    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-gsbqz"
Sep 06 10:30:32.115960 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:32.115931    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:30:32.614249 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:32.614214    2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-426bc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 06 10:30:32.614457 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:32.614279    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc" podUID="60de9283-9f89-4fdc-9874-73ea1fb3d134" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 06 10:30:33.618044 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:33.618010    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:30:33.618979 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:33.618956    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-426bc"
Sep 06 10:30:35.536683 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:35.536652    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:30:42.125412 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:42.125311    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:30:53.896606 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:53.896572    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"]
Sep 06 10:30:53.901055 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:53.901029    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:30:53.904988 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:53.904962    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 06 10:30:53.904988 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:53.904981    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 06 10:30:53.904988 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:53.905053    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 06 10:30:53.905428 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:53.905061    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zm5kx\""
Sep 06 10:30:53.907883 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:53.907854    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"]
Sep 06 10:30:53.921891 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:53.921861    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:30:53.965151 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:53.965110    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e30156f-eb5e-425d-9753-6bbee1deeead-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp\" (UID: \"1e30156f-eb5e-425d-9753-6bbee1deeead\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:30:53.965151 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:53.965154    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcwk4\" (UniqueName: \"kubernetes.io/projected/1e30156f-eb5e-425d-9753-6bbee1deeead-kube-api-access-pcwk4\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp\" (UID: \"1e30156f-eb5e-425d-9753-6bbee1deeead\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:30:53.965433 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:53.965175    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e30156f-eb5e-425d-9753-6bbee1deeead-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp\" (UID: \"1e30156f-eb5e-425d-9753-6bbee1deeead\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:30:53.965433 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:53.965247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e30156f-eb5e-425d-9753-6bbee1deeead-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp\" (UID: \"1e30156f-eb5e-425d-9753-6bbee1deeead\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:30:53.965433 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:53.965288    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e30156f-eb5e-425d-9753-6bbee1deeead-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp\" (UID: \"1e30156f-eb5e-425d-9753-6bbee1deeead\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:30:53.965433 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:53.965398    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e30156f-eb5e-425d-9753-6bbee1deeead-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp\" (UID: \"1e30156f-eb5e-425d-9753-6bbee1deeead\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:30:54.066742 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:54.066697    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e30156f-eb5e-425d-9753-6bbee1deeead-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp\" (UID: \"1e30156f-eb5e-425d-9753-6bbee1deeead\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:30:54.066943 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:54.066755    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcwk4\" (UniqueName: \"kubernetes.io/projected/1e30156f-eb5e-425d-9753-6bbee1deeead-kube-api-access-pcwk4\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp\" (UID: \"1e30156f-eb5e-425d-9753-6bbee1deeead\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:30:54.066943 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:54.066783    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e30156f-eb5e-425d-9753-6bbee1deeead-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp\" (UID: \"1e30156f-eb5e-425d-9753-6bbee1deeead\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:30:54.066943 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:54.066818    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e30156f-eb5e-425d-9753-6bbee1deeead-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp\" (UID: \"1e30156f-eb5e-425d-9753-6bbee1deeead\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:30:54.066943 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:54.066837    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e30156f-eb5e-425d-9753-6bbee1deeead-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp\" (UID: \"1e30156f-eb5e-425d-9753-6bbee1deeead\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:30:54.066943 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:54.066906    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e30156f-eb5e-425d-9753-6bbee1deeead-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp\" (UID: \"1e30156f-eb5e-425d-9753-6bbee1deeead\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:30:54.067244 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:54.067228    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e30156f-eb5e-425d-9753-6bbee1deeead-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp\" (UID: \"1e30156f-eb5e-425d-9753-6bbee1deeead\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:30:54.067307 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:54.067231    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e30156f-eb5e-425d-9753-6bbee1deeead-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp\" (UID: \"1e30156f-eb5e-425d-9753-6bbee1deeead\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:30:54.067404 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:54.067353    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e30156f-eb5e-425d-9753-6bbee1deeead-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp\" (UID: \"1e30156f-eb5e-425d-9753-6bbee1deeead\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:30:54.069099 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:54.069073    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e30156f-eb5e-425d-9753-6bbee1deeead-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp\" (UID: \"1e30156f-eb5e-425d-9753-6bbee1deeead\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:30:54.069348 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:54.069304    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e30156f-eb5e-425d-9753-6bbee1deeead-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp\" (UID: \"1e30156f-eb5e-425d-9753-6bbee1deeead\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:30:54.075231 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:54.075202    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcwk4\" (UniqueName: \"kubernetes.io/projected/1e30156f-eb5e-425d-9753-6bbee1deeead-kube-api-access-pcwk4\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp\" (UID: \"1e30156f-eb5e-425d-9753-6bbee1deeead\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:30:54.214254 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:54.214224    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:30:54.487104 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:54.487074    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"]
Sep 06 10:30:54.488699 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:30:54.488674    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e30156f_eb5e_425d_9753_6bbee1deeead.slice/crio-9e990fbc1fc6b9486da81bf42789fcb80c92419bc9be7be6562d227d969f17ac WatchSource:0}: Error finding container 9e990fbc1fc6b9486da81bf42789fcb80c92419bc9be7be6562d227d969f17ac: Status 404 returned error can't find the container with id 9e990fbc1fc6b9486da81bf42789fcb80c92419bc9be7be6562d227d969f17ac
Sep 06 10:30:54.874598 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:54.874490    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp" event={"ID":"1e30156f-eb5e-425d-9753-6bbee1deeead","Type":"ContainerStarted","Data":"9e990fbc1fc6b9486da81bf42789fcb80c92419bc9be7be6562d227d969f17ac"}
Sep 06 10:30:55.882139 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:55.882043    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp" event={"ID":"1e30156f-eb5e-425d-9753-6bbee1deeead","Type":"ContainerStarted","Data":"314dd5898eaa084d6f8a2e1babb2f681efa37d6f4796aaaa938157db555b09ba"}
Sep 06 10:30:55.900615 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:30:55.900555    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp" podStartSLOduration=1.947640728 podStartE2EDuration="2.900539703s" totalImagesPullingTime="952.898975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:30:55.898245071 +0000 UTC m=+547.676664489" watchObservedRunningTime="2026-09-06 10:30:55.900539703 +0000 UTC m=+547.678959176"
Sep 06 10:31:03.218931 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:03.218897    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:31:03.784813 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:03.784773    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:31:03.875681 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:03.875648    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:31:04.214679 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:04.214646    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:31:04.214840 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:04.214716    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:31:04.226938 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:04.226908    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:31:04.947458 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:04.947420    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp"
Sep 06 10:31:17.115126 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:17.115087    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:31:19.306409 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.306378    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"]
Sep 06 10:31:19.309815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.309798    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:19.312941 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.312922    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 06 10:31:19.319895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.319873    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"]
Sep 06 10:31:19.330939 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.330919    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:31:19.401092 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.401059    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t4mp\" (UniqueName: \"kubernetes.io/projected/853f7558-e474-4eb0-811e-95a5159296e6-kube-api-access-6t4mp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h\" (UID: \"853f7558-e474-4eb0-811e-95a5159296e6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:19.401222 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.401102    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/853f7558-e474-4eb0-811e-95a5159296e6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h\" (UID: \"853f7558-e474-4eb0-811e-95a5159296e6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:19.401222 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.401129    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/853f7558-e474-4eb0-811e-95a5159296e6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h\" (UID: \"853f7558-e474-4eb0-811e-95a5159296e6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:19.401222 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.401206    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/853f7558-e474-4eb0-811e-95a5159296e6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h\" (UID: \"853f7558-e474-4eb0-811e-95a5159296e6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:19.401377 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.401240    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/853f7558-e474-4eb0-811e-95a5159296e6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h\" (UID: \"853f7558-e474-4eb0-811e-95a5159296e6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:19.401377 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.401267    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/853f7558-e474-4eb0-811e-95a5159296e6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h\" (UID: \"853f7558-e474-4eb0-811e-95a5159296e6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:19.502388 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.502354    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/853f7558-e474-4eb0-811e-95a5159296e6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h\" (UID: \"853f7558-e474-4eb0-811e-95a5159296e6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:19.502542 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.502398    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/853f7558-e474-4eb0-811e-95a5159296e6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h\" (UID: \"853f7558-e474-4eb0-811e-95a5159296e6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:19.502542 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.502429    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/853f7558-e474-4eb0-811e-95a5159296e6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h\" (UID: \"853f7558-e474-4eb0-811e-95a5159296e6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:19.502542 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.502520    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t4mp\" (UniqueName: \"kubernetes.io/projected/853f7558-e474-4eb0-811e-95a5159296e6-kube-api-access-6t4mp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h\" (UID: \"853f7558-e474-4eb0-811e-95a5159296e6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:19.502698 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.502552    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/853f7558-e474-4eb0-811e-95a5159296e6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h\" (UID: \"853f7558-e474-4eb0-811e-95a5159296e6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:19.502698 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.502579    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/853f7558-e474-4eb0-811e-95a5159296e6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h\" (UID: \"853f7558-e474-4eb0-811e-95a5159296e6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:19.502813 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.502754    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/853f7558-e474-4eb0-811e-95a5159296e6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h\" (UID: \"853f7558-e474-4eb0-811e-95a5159296e6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:19.502915 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.502895    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/853f7558-e474-4eb0-811e-95a5159296e6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h\" (UID: \"853f7558-e474-4eb0-811e-95a5159296e6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:19.502977 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.502927    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/853f7558-e474-4eb0-811e-95a5159296e6-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h\" (UID: \"853f7558-e474-4eb0-811e-95a5159296e6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:19.504738 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.504715    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/853f7558-e474-4eb0-811e-95a5159296e6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h\" (UID: \"853f7558-e474-4eb0-811e-95a5159296e6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:19.504967 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.504951    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/853f7558-e474-4eb0-811e-95a5159296e6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h\" (UID: \"853f7558-e474-4eb0-811e-95a5159296e6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:19.510981 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.510959    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t4mp\" (UniqueName: \"kubernetes.io/projected/853f7558-e474-4eb0-811e-95a5159296e6-kube-api-access-6t4mp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h\" (UID: \"853f7558-e474-4eb0-811e-95a5159296e6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:19.621136 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.621027    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:19.898089 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:19.897995    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"]
Sep 06 10:31:19.903351 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:31:19.903310    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod853f7558_e474_4eb0_811e_95a5159296e6.slice/crio-5e7b3e59a14b8ccc114bad88b3f2be24cf574058507759fd0684255b48a455f9 WatchSource:0}: Error finding container 5e7b3e59a14b8ccc114bad88b3f2be24cf574058507759fd0684255b48a455f9: Status 404 returned error can't find the container with id 5e7b3e59a14b8ccc114bad88b3f2be24cf574058507759fd0684255b48a455f9
Sep 06 10:31:20.012634 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:20.012596    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h" event={"ID":"853f7558-e474-4eb0-811e-95a5159296e6","Type":"ContainerStarted","Data":"5e7b3e59a14b8ccc114bad88b3f2be24cf574058507759fd0684255b48a455f9"}
Sep 06 10:31:21.019627 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:21.019588    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h" event={"ID":"853f7558-e474-4eb0-811e-95a5159296e6","Type":"ContainerStarted","Data":"880423a68492db472aec3d49dbbc9f101a02f06d6c9e44b5b5cb88f77df01b27"}
Sep 06 10:31:21.040098 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:21.040049    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h" podStartSLOduration=1.876536244 podStartE2EDuration="2.040033496s" totalImagesPullingTime="163.497252ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:31:21.037752567 +0000 UTC m=+572.816171981" watchObservedRunningTime="2026-09-06 10:31:21.040033496 +0000 UTC m=+572.818452909"
Sep 06 10:31:21.327925 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:21.327831    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:31:29.619581 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:29.619549    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:31:29.621531 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:29.621510    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:29.621615 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:29.621568    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:29.639541 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:29.639516    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:30.088571 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:30.088545    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h"
Sep 06 10:31:35.492350 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:35.492299    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:31:35.546614 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:35.546571    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:31:48.688652 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:48.688616    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/1.log"
Sep 06 10:31:48.689142 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:48.688955    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/1.log"
Sep 06 10:31:48.695687 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:48.695662    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsw6t_a4733769-37b3-443b-9ee5-d93bd5f167f0/ovn-acl-logging/0.log"
Sep 06 10:31:48.696058 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:31:48.696041    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsw6t_a4733769-37b3-443b-9ee5-d93bd5f167f0/ovn-acl-logging/0.log"
Sep 06 10:32:33.641015 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:33.640981    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:32:33.737603 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:33.737571    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:32:34.797693 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:34.797634    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:32:34.889023 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:34.888990    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:32:50.129423 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.129379    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:32:50.418100 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.418064    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"]
Sep 06 10:32:50.421813 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.421789    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.424036 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.424013    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-04526a-openshift-default-dockercfg-tghqf\""
Sep 06 10:32:50.433305 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.433280    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"]
Sep 06 10:32:50.435638 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.435611    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cws4v\" (UniqueName: \"kubernetes.io/projected/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-kube-api-access-cws4v\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.435775 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.435656    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istiod-ca-cert\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.435775 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.435750    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-credential-socket\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.435908 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.435783    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-workload-certs\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.435908 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.435858    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-data\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.435908 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.435890    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-envoy\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.436055 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.435913    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-workload-socket\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.436055 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.435933    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-token\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.436055 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.435990    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-podinfo\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.537260 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.537222    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-credential-socket\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.537546 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.537517    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-workload-certs\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.537646 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.537567    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-data\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.537646 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.537600    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-envoy\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.537646 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.537626    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-workload-socket\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.537807 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.537649    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-token\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.537807 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.537653    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-credential-socket\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.537974 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.537950    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-data\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.538056 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.538008    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-podinfo\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.538056 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.538020    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-workload-socket\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.538221 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.538170    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cws4v\" (UniqueName: \"kubernetes.io/projected/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-kube-api-access-cws4v\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.538221 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.538215    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istiod-ca-cert\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.538980 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.538935    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istiod-ca-cert\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.539396 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.539371    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-workload-certs\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.540197 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.540140    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-envoy\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.540883 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.540860    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-podinfo\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.546191 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.546161    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cws4v\" (UniqueName: \"kubernetes.io/projected/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-kube-api-access-cws4v\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.546191 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.546185    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-token\") pod \"e2e-inf-a-04526a-openshift-default-76b687fd-lld55\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") " pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:50.734065 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:50.733971    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:51.018093 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:51.018063    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"]
Sep 06 10:32:51.019707 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:32:51.019679    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e7ea27e_f8d9_4b83_b8fc_7292f6316cd9.slice/crio-37e0700950670d8972079c5377f651da6c51bd6ae2b63fbcb03339e0f69b3e4f WatchSource:0}: Error finding container 37e0700950670d8972079c5377f651da6c51bd6ae2b63fbcb03339e0f69b3e4f: Status 404 returned error can't find the container with id 37e0700950670d8972079c5377f651da6c51bd6ae2b63fbcb03339e0f69b3e4f
Sep 06 10:32:51.022401 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:51.022367    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:32:51.022488 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:51.022432    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:32:51.022488 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:51.022462    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:32:51.543264 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:51.543224    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55" event={"ID":"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9","Type":"ContainerStarted","Data":"834e1cc4fb154e8bade93b9a02d17113372ed8a89d4d481261f085474597663e"}
Sep 06 10:32:51.543737 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:51.543277    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55" event={"ID":"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9","Type":"ContainerStarted","Data":"37e0700950670d8972079c5377f651da6c51bd6ae2b63fbcb03339e0f69b3e4f"}
Sep 06 10:32:51.568153 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:51.568095    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55" podStartSLOduration=1.568074498 podStartE2EDuration="1.568074498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:32:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:32:51.564839914 +0000 UTC m=+663.343259352" watchObservedRunningTime="2026-09-06 10:32:51.568074498 +0000 UTC m=+663.346493913"
Sep 06 10:32:51.657162 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:51.657132    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:32:51.734626 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:51.734591    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:51.968570 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:51.968535    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:32:52.740069 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:52.740038    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:53.502729 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:53.502695    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:32:53.554868 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:53.554832    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:53.555644 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:53.555625    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:32:53.608939 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:53.608908    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:32:54.844355 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:54.844314    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:32:54.947950 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:54.947920    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:32:55.088668 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:55.088633    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:32:55.323769 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:55.323738    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:32:55.422729 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:55.422697    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:32:57.849445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:57.849410    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:32:57.950029 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:57.949997    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:32:58.074692 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.074663    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:32:58.357004 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.356962    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"]
Sep 06 10:32:58.360951 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.360925    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.363987 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.363964    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-dbaf75b1-openshift-default-dockercfg-42fqd\""
Sep 06 10:32:58.371750 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.371729    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"]
Sep 06 10:32:58.395297 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.395272    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:32:58.410647 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.410619    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-credential-socket\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.410785 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.410652    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-podinfo\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.410785 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.410713    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-token\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.410785 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.410752    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5rfj\" (UniqueName: \"kubernetes.io/projected/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-kube-api-access-v5rfj\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.410785 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.410774    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istiod-ca-cert\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.411007 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.410799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-envoy\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.411007 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.410818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-data\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.411007 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.410877    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-workload-socket\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.411007 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.410933    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-workload-certs\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.512184 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.512149    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-envoy\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.512184 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.512187    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-data\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.512477 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.512335    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-workload-socket\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.512477 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.512402    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-workload-certs\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.512591 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.512506    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-credential-socket\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.512591 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.512535    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-podinfo\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.512591 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.512551    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-data\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.512754 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.512605    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-token\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.512754 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.512647    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5rfj\" (UniqueName: \"kubernetes.io/projected/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-kube-api-access-v5rfj\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.512754 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.512648    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-workload-socket\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.512754 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.512675    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istiod-ca-cert\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.512754 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.512706    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-workload-certs\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.513032 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.512868    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-credential-socket\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.513358 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.513311    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istiod-ca-cert\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.514566 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.514546    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-envoy\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.514895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.514877    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-podinfo\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.520918 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.520889    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-token\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.521191 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.521172    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5rfj\" (UniqueName: \"kubernetes.io/projected/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-kube-api-access-v5rfj\") pod \"e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") " pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.673910 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.673876    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:58.682528 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.682503    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:32:58.953525 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.953499    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"]
Sep 06 10:32:58.954805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:32:58.954775    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b68a9c7_d971_4f3d_af6f_3b551e9d1786.slice/crio-49d6b9288e32c87fe200fe1fc6cad2d29230743ca5b1eb1c35e92fd3b703fc8b WatchSource:0}: Error finding container 49d6b9288e32c87fe200fe1fc6cad2d29230743ca5b1eb1c35e92fd3b703fc8b: Status 404 returned error can't find the container with id 49d6b9288e32c87fe200fe1fc6cad2d29230743ca5b1eb1c35e92fd3b703fc8b
Sep 06 10:32:58.957002 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.956967    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:32:58.957079 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.957059    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:32:58.957126 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:58.957109    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:32:59.601406 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:59.601366    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4" event={"ID":"1b68a9c7-d971-4f3d-af6f-3b551e9d1786","Type":"ContainerStarted","Data":"a81f13aaa01d2cff151c6424376231d4313186477566dea9b100b03527359bbd"}
Sep 06 10:32:59.601581 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:59.601430    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4" event={"ID":"1b68a9c7-d971-4f3d-af6f-3b551e9d1786","Type":"ContainerStarted","Data":"49d6b9288e32c87fe200fe1fc6cad2d29230743ca5b1eb1c35e92fd3b703fc8b"}
Sep 06 10:32:59.623442 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:59.623384    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4" podStartSLOduration=1.623364922 podStartE2EDuration="1.623364922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:32:59.620613888 +0000 UTC m=+671.399033304" watchObservedRunningTime="2026-09-06 10:32:59.623364922 +0000 UTC m=+671.401784336"
Sep 06 10:32:59.674303 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:59.674267    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:32:59.887995 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:32:59.887904    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:00.198678 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:00.198640    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:00.600881 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:00.600779    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:00.680376 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:00.680341    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:33:00.981089 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:00.981036    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:01.074763 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:01.074731    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:01.612700 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:01.612663    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:33:01.613636 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:01.613601    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:33:02.157276 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:02.157183    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:02.238339 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:02.238292    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:02.685080 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:02.685052    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:02.783397 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:02.783363    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:03.556058 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:03.556016    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:04.708979 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:04.708949    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:06.163725 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:06.163687    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:06.260550 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:06.260520    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:07.438577 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:07.438544    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:07.498536 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:07.498507    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:07.947816 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:07.947787    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:08.054767 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:08.054725    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:08.119770 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:08.119733    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk"]
Sep 06 10:33:08.123618 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:08.123594    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk"
Sep 06 10:33:08.126154 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:08.126133    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-5dda3d\""
Sep 06 10:33:08.126265 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:08.126165    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-5dda3d-dockercfg-v5cbx\""
Sep 06 10:33:08.132072 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:08.132045    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk"]
Sep 06 10:33:08.214370 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:08.214233    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:08.224753 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:08.224725    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk\" (UID: \"023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk"
Sep 06 10:33:08.224908 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:08.224782    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thtqr\" (UniqueName: \"kubernetes.io/projected/023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb-kube-api-access-thtqr\") pod \"payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk\" (UID: \"023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk"
Sep 06 10:33:08.325860 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:08.325809    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk\" (UID: \"023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk"
Sep 06 10:33:08.326036 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:08.325892    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thtqr\" (UniqueName: \"kubernetes.io/projected/023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb-kube-api-access-thtqr\") pod \"payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk\" (UID: \"023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk"
Sep 06 10:33:08.326591 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:08.326572    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk\" (UID: \"023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk"
Sep 06 10:33:08.334794 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:08.334757    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thtqr\" (UniqueName: \"kubernetes.io/projected/023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb-kube-api-access-thtqr\") pod \"payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk\" (UID: \"023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk"
Sep 06 10:33:08.438769 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:08.438729    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk"
Sep 06 10:33:08.726455 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:08.726423    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk"]
Sep 06 10:33:08.727551 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:33:08.727522    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023ff6c2_fcb8_4aae_902a_f7c69f9ae3eb.slice/crio-9086a3c76961fc23faeb92d43d7a2e7a98b725f071e0cda4e1b587d88112dd4d WatchSource:0}: Error finding container 9086a3c76961fc23faeb92d43d7a2e7a98b725f071e0cda4e1b587d88112dd4d: Status 404 returned error can't find the container with id 9086a3c76961fc23faeb92d43d7a2e7a98b725f071e0cda4e1b587d88112dd4d
Sep 06 10:33:09.028258 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:09.028172    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:09.173455 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:09.173375    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:09.287635 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:09.287558    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:09.389917 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:09.389863    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:09.597521 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:09.597433    2561 patch_prober.go:28] interesting pod/e2e-inf-a-04526a-openshift-default-76b687fd-lld55 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 10:33:09.597521 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:09.597487    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55" podUID="6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 10:33:09.669477 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:09.669430    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk" event={"ID":"023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb","Type":"ContainerStarted","Data":"12cd57553bb6592bd79818f43d80da0a0018e056b92385493eb54398b62bda92"}
Sep 06 10:33:09.669671 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:09.669503    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk" event={"ID":"023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb","Type":"ContainerStarted","Data":"9086a3c76961fc23faeb92d43d7a2e7a98b725f071e0cda4e1b587d88112dd4d"}
Sep 06 10:33:09.670662 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:09.670636    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk"
Sep 06 10:33:09.686901 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:09.686857    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk" podStartSLOduration=1.686845258 podStartE2EDuration="1.686845258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:33:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:33:09.685195899 +0000 UTC m=+681.463615313" watchObservedRunningTime="2026-09-06 10:33:09.686845258 +0000 UTC m=+681.465264700"
Sep 06 10:33:10.679129 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:10.679028    2561 generic.go:356] "Generic (PLEG): container finished" podID="6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" containerID="834e1cc4fb154e8bade93b9a02d17113372ed8a89d4d481261f085474597663e" exitCode=0
Sep 06 10:33:10.679129 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:10.679105    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55" event={"ID":"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9","Type":"ContainerDied","Data":"834e1cc4fb154e8bade93b9a02d17113372ed8a89d4d481261f085474597663e"}
Sep 06 10:33:10.679693 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:10.679566    2561 scope.go:117] "RemoveContainer" containerID="834e1cc4fb154e8bade93b9a02d17113372ed8a89d4d481261f085474597663e"
Sep 06 10:33:10.680670 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:10.680640    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:33:10.680775 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:10.680718    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:33:10.680775 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:10.680751    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:33:11.692983 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:11.692945    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55" event={"ID":"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9","Type":"ContainerStarted","Data":"5974e6e3c4499bc15a93590cbb9d3d56e091ff90b63e5100b8f224e1dc92876e"}
Sep 06 10:33:11.734718 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:11.734676    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:33:11.735142 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:11.735106    2561 patch_prober.go:28] interesting pod/e2e-inf-a-04526a-openshift-default-76b687fd-lld55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 06 10:33:11.735228 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:11.735176    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55" podUID="6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 06 10:33:12.082248 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:12.082127    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:12.734906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:12.734826    2561 patch_prober.go:28] interesting pod/e2e-inf-a-04526a-openshift-default-76b687fd-lld55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 06 10:33:12.735444 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:12.734949    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55" podUID="6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 06 10:33:13.699450 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:13.699411    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:13.734590 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:13.734527    2561 patch_prober.go:28] interesting pod/e2e-inf-a-04526a-openshift-default-76b687fd-lld55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 06 10:33:13.734798 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:13.734647    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55" podUID="6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 06 10:33:14.734857 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:14.734809    2561 patch_prober.go:28] interesting pod/e2e-inf-a-04526a-openshift-default-76b687fd-lld55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 06 10:33:14.735382 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:14.734888    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55" podUID="6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 06 10:33:15.734837 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:15.734400    2561 patch_prober.go:28] interesting pod/e2e-inf-a-04526a-openshift-default-76b687fd-lld55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 06 10:33:15.734837 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:15.734470    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55" podUID="6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 06 10:33:15.815727 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:15.815687    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:16.734798 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:16.734748    2561 patch_prober.go:28] interesting pod/e2e-inf-a-04526a-openshift-default-76b687fd-lld55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 06 10:33:16.735010 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:16.734822    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55" podUID="6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 06 10:33:17.654516 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:17.654476    2561 patch_prober.go:28] interesting pod/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 10:33:17.654692 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:17.654541    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4" podUID="1b68a9c7-d971-4f3d-af6f-3b551e9d1786" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 10:33:17.739498 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:17.739459    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:33:17.739980 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:17.739858    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:33:17.740810 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:17.740787    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:33:18.508542 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:18.508511    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:18.738840 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:18.738766    2561 generic.go:356] "Generic (PLEG): container finished" podID="1b68a9c7-d971-4f3d-af6f-3b551e9d1786" containerID="a81f13aaa01d2cff151c6424376231d4313186477566dea9b100b03527359bbd" exitCode=0
Sep 06 10:33:18.738994 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:18.738848    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4" event={"ID":"1b68a9c7-d971-4f3d-af6f-3b551e9d1786","Type":"ContainerDied","Data":"a81f13aaa01d2cff151c6424376231d4313186477566dea9b100b03527359bbd"}
Sep 06 10:33:18.739392 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:18.739369    2561 scope.go:117] "RemoveContainer" containerID="a81f13aaa01d2cff151c6424376231d4313186477566dea9b100b03527359bbd"
Sep 06 10:33:18.740470 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:18.740444    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:33:18.740745 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:18.740515    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:33:18.740745 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:18.740545    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:33:18.919299 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:18.919214    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:19.134189 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.134105    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"]
Sep 06 10:33:19.138465 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.138436    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.141021 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.140997    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-bd3407-openshift-default-dockercfg-l6v7t\""
Sep 06 10:33:19.151104 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.151078    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"]
Sep 06 10:33:19.171144 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.171105    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:19.256651 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.256620    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-data\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.256858 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.256669    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-workload-certs\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.256858 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.256756    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-envoy\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.256858 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.256808    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-credential-socket\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.256858 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.256837    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/160689e4-3c5a-4be0-a457-de7df77fccb5-istiod-ca-cert\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.257091 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.256862    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-podinfo\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.257091 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.256940    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bcmg\" (UniqueName: \"kubernetes.io/projected/160689e4-3c5a-4be0-a457-de7df77fccb5-kube-api-access-4bcmg\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.257091 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.256964    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-workload-socket\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.257091 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.257008    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-token\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.358607 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.358541    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-podinfo\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.358821 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.358652    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bcmg\" (UniqueName: \"kubernetes.io/projected/160689e4-3c5a-4be0-a457-de7df77fccb5-kube-api-access-4bcmg\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.358821 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.358684    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-workload-socket\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.358821 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.358738    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-token\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.358821 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.358809    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-data\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.359064 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.358850    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-workload-certs\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.359064 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.358880    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-envoy\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.359064 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.358922    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-credential-socket\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.359064 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.358947    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/160689e4-3c5a-4be0-a457-de7df77fccb5-istiod-ca-cert\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.359848 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.359806    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/160689e4-3c5a-4be0-a457-de7df77fccb5-istiod-ca-cert\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.360551 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.360525    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-data\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.361077 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.360809    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-workload-socket\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.361077 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.361032    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-workload-certs\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.361250 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.361080    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-credential-socket\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.362854 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.362829    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-podinfo\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.363849 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.363819    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-envoy\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.371042 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.371024    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-token\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.374999 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.374978    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bcmg\" (UniqueName: \"kubernetes.io/projected/160689e4-3c5a-4be0-a457-de7df77fccb5-kube-api-access-4bcmg\") pod \"e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") " pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.446906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.446849    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:19.449992 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.449731    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:19.742844 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.742809    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"]
Sep 06 10:33:19.751344 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:33:19.750467    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod160689e4_3c5a_4be0_a457_de7df77fccb5.slice/crio-cabad36da7449401871b5132ff56d935fb416ef59de8462361d160ba8ed85b86 WatchSource:0}: Error finding container cabad36da7449401871b5132ff56d935fb416ef59de8462361d160ba8ed85b86: Status 404 returned error can't find the container with id cabad36da7449401871b5132ff56d935fb416ef59de8462361d160ba8ed85b86
Sep 06 10:33:19.755344 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.754884    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4" event={"ID":"1b68a9c7-d971-4f3d-af6f-3b551e9d1786","Type":"ContainerStarted","Data":"f68495d747b181fb6b4e54c5bf19742948fc11e94078c81c73338393a455eff4"}
Sep 06 10:33:19.759149 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.757435    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:33:19.759149 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.757514    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:33:19.759149 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:19.757553    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:33:20.675143 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:20.675100    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:33:20.675946 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:20.675620    2561 patch_prober.go:28] interesting pod/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 06 10:33:20.675946 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:20.675681    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4" podUID="1b68a9c7-d971-4f3d-af6f-3b551e9d1786" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 06 10:33:20.681792 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:20.681767    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk"
Sep 06 10:33:20.779208 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:20.779177    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm" event={"ID":"160689e4-3c5a-4be0-a457-de7df77fccb5","Type":"ContainerStarted","Data":"bfbc005034174a355fd563096e79905cc8abf92b087657b8b052d9b2f327d487"}
Sep 06 10:33:20.779598 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:20.779227    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm" event={"ID":"160689e4-3c5a-4be0-a457-de7df77fccb5","Type":"ContainerStarted","Data":"cabad36da7449401871b5132ff56d935fb416ef59de8462361d160ba8ed85b86"}
Sep 06 10:33:21.450671 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:21.450627    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:21.461599 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:21.461561    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:21.482728 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:21.482675    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm" podStartSLOduration=2.482658452 podStartE2EDuration="2.482658452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:33:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:33:20.796366258 +0000 UTC m=+692.574785673" watchObservedRunningTime="2026-09-06 10:33:21.482658452 +0000 UTC m=+693.261077867"
Sep 06 10:33:21.675238 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:21.675194    2561 patch_prober.go:28] interesting pod/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 06 10:33:21.675436 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:21.675263    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4" podUID="1b68a9c7-d971-4f3d-af6f-3b551e9d1786" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 06 10:33:21.784197 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:21.784119    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:21.784972 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:21.784953    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:22.674496 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:22.674458    2561 patch_prober.go:28] interesting pod/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 06 10:33:22.674665 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:22.674530    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4" podUID="1b68a9c7-d971-4f3d-af6f-3b551e9d1786" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 06 10:33:22.770463 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:22.770419    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:22.870243 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:22.870211    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:23.130414 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:23.130311    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:23.675076 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:23.675039    2561 patch_prober.go:28] interesting pod/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 06 10:33:23.675256 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:23.675094    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4" podUID="1b68a9c7-d971-4f3d-af6f-3b551e9d1786" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 06 10:33:23.687462 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:23.687429    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:23.810974 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:23.810940    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:23.911525 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:23.911464    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:24.145908 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:24.145817    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:24.242810 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:24.242758    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:24.339735 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:24.339694    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:24.650078 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:24.650032    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:24.676590 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:24.676554    2561 patch_prober.go:28] interesting pod/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 06 10:33:24.676877 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:24.676843    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4" podUID="1b68a9c7-d971-4f3d-af6f-3b551e9d1786" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 06 10:33:24.722742 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:24.722694    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:24.768777 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:24.768737    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4"]
Sep 06 10:33:24.772631 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:24.772615    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4"
Sep 06 10:33:24.774979 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:24.774953    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-bd3407\""
Sep 06 10:33:24.775109 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:24.775012    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-bd3407-dockercfg-cz4x4\""
Sep 06 10:33:24.783431 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:24.783402    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4"]
Sep 06 10:33:24.827203 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:24.827163    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm9xj\" (UniqueName: \"kubernetes.io/projected/89ec3933-7417-4bc5-88fa-82273c8f5c82-kube-api-access-gm9xj\") pod \"payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4\" (UID: \"89ec3933-7417-4bc5-88fa-82273c8f5c82\") " pod="openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4"
Sep 06 10:33:24.827405 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:24.827258    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89ec3933-7417-4bc5-88fa-82273c8f5c82-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4\" (UID: \"89ec3933-7417-4bc5-88fa-82273c8f5c82\") " pod="openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4"
Sep 06 10:33:24.928617 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:24.928585    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm9xj\" (UniqueName: \"kubernetes.io/projected/89ec3933-7417-4bc5-88fa-82273c8f5c82-kube-api-access-gm9xj\") pod \"payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4\" (UID: \"89ec3933-7417-4bc5-88fa-82273c8f5c82\") " pod="openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4"
Sep 06 10:33:24.928988 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:24.928675    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89ec3933-7417-4bc5-88fa-82273c8f5c82-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4\" (UID: \"89ec3933-7417-4bc5-88fa-82273c8f5c82\") " pod="openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4"
Sep 06 10:33:24.929393 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:24.929372    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89ec3933-7417-4bc5-88fa-82273c8f5c82-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4\" (UID: \"89ec3933-7417-4bc5-88fa-82273c8f5c82\") " pod="openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4"
Sep 06 10:33:24.938444 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:24.938281    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm9xj\" (UniqueName: \"kubernetes.io/projected/89ec3933-7417-4bc5-88fa-82273c8f5c82-kube-api-access-gm9xj\") pod \"payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4\" (UID: \"89ec3933-7417-4bc5-88fa-82273c8f5c82\") " pod="openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4"
Sep 06 10:33:25.042793 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:25.042757    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:25.084751 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:25.084715    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4"
Sep 06 10:33:25.374776 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:25.374744    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4"]
Sep 06 10:33:25.375813 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:33:25.375787    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89ec3933_7417_4bc5_88fa_82273c8f5c82.slice/crio-85b1c57d3c2ff14795d3f7b23b76d38a5f0863531549fe5c8fc8d2b05ad95fa2 WatchSource:0}: Error finding container 85b1c57d3c2ff14795d3f7b23b76d38a5f0863531549fe5c8fc8d2b05ad95fa2: Status 404 returned error can't find the container with id 85b1c57d3c2ff14795d3f7b23b76d38a5f0863531549fe5c8fc8d2b05ad95fa2
Sep 06 10:33:25.678561 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:25.678529    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:33:25.678844 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:25.678809    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:33:25.679639 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:25.679621    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:33:25.814312 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:25.814278    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4" event={"ID":"89ec3933-7417-4bc5-88fa-82273c8f5c82","Type":"ContainerStarted","Data":"cc85a7131e36e6c450dd9c708cf0a66d5572da06ddad58b5e9bac9a18e7bad2e"}
Sep 06 10:33:25.814495 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:25.814431    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4"
Sep 06 10:33:25.814495 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:25.814460    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4" event={"ID":"89ec3933-7417-4bc5-88fa-82273c8f5c82","Type":"ContainerStarted","Data":"85b1c57d3c2ff14795d3f7b23b76d38a5f0863531549fe5c8fc8d2b05ad95fa2"}
Sep 06 10:33:25.832421 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:25.832371    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4" podStartSLOduration=1.83235658 podStartE2EDuration="1.83235658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:33:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:33:25.831380034 +0000 UTC m=+697.609799439" watchObservedRunningTime="2026-09-06 10:33:25.83235658 +0000 UTC m=+697.610775994"
Sep 06 10:33:25.911292 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:25.911235    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:26.458670 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:26.458635    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dbaf75b1-lxhxl"]
Sep 06 10:33:26.462634 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:26.462615    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dbaf75b1-lxhxl"
Sep 06 10:33:26.464990 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:26.464969    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n5b2f\""
Sep 06 10:33:26.469740 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:26.469715    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dbaf75b1-lxhxl"]
Sep 06 10:33:26.545071 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:26.545041    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6a68df1-2021-4c20-b027-003b1c9b0a7b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-dbaf75b1-lxhxl\" (UID: \"e6a68df1-2021-4c20-b027-003b1c9b0a7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dbaf75b1-lxhxl"
Sep 06 10:33:26.645906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:26.645873    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6a68df1-2021-4c20-b027-003b1c9b0a7b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-dbaf75b1-lxhxl\" (UID: \"e6a68df1-2021-4c20-b027-003b1c9b0a7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dbaf75b1-lxhxl"
Sep 06 10:33:26.646541 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:26.646518    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6a68df1-2021-4c20-b027-003b1c9b0a7b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-dbaf75b1-lxhxl\" (UID: \"e6a68df1-2021-4c20-b027-003b1c9b0a7b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dbaf75b1-lxhxl"
Sep 06 10:33:26.739054 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:26.738966    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:26.775453 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:26.775413    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dbaf75b1-lxhxl"
Sep 06 10:33:27.054163 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:27.054133    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dbaf75b1-lxhxl"]
Sep 06 10:33:27.054827 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:33:27.054803    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6a68df1_2021_4c20_b027_003b1c9b0a7b.slice/crio-34d7edd6e1eb0afb639f4401bc730e124ef792fb78a92641fef3ae4a3c7d1e88 WatchSource:0}: Error finding container 34d7edd6e1eb0afb639f4401bc730e124ef792fb78a92641fef3ae4a3c7d1e88: Status 404 returned error can't find the container with id 34d7edd6e1eb0afb639f4401bc730e124ef792fb78a92641fef3ae4a3c7d1e88
Sep 06 10:33:27.056892 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:27.056874    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 10:33:27.829757 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:27.829719    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dbaf75b1-lxhxl" event={"ID":"e6a68df1-2021-4c20-b027-003b1c9b0a7b","Type":"ContainerStarted","Data":"34d7edd6e1eb0afb639f4401bc730e124ef792fb78a92641fef3ae4a3c7d1e88"}
Sep 06 10:33:28.522903 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:28.522865    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:29.937366 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:29.937316    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:30.093393 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:30.093365    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:30.187339 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:30.187302    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:30.287525 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:30.287432    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:30.852859 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:30.852824    2561 generic.go:356] "Generic (PLEG): container finished" podID="e6a68df1-2021-4c20-b027-003b1c9b0a7b" containerID="f7a461ab9222cb9086e193ed90f104504bd9ea88f3fdfc76646d206f48e8abd5" exitCode=0
Sep 06 10:33:30.852859 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:30.852855    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dbaf75b1-lxhxl" event={"ID":"e6a68df1-2021-4c20-b027-003b1c9b0a7b","Type":"ContainerDied","Data":"f7a461ab9222cb9086e193ed90f104504bd9ea88f3fdfc76646d206f48e8abd5"}
Sep 06 10:33:31.121532 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:31.121435    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:32.005258 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:32.005234    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dbaf75b1-lxhxl"
Sep 06 10:33:32.108304 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:32.108266    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6a68df1-2021-4c20-b027-003b1c9b0a7b-maas-api-service-ca\") pod \"e6a68df1-2021-4c20-b027-003b1c9b0a7b\" (UID: \"e6a68df1-2021-4c20-b027-003b1c9b0a7b\") "
Sep 06 10:33:32.108708 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:32.108685    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6a68df1-2021-4c20-b027-003b1c9b0a7b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e6a68df1-2021-4c20-b027-003b1c9b0a7b" (UID: "e6a68df1-2021-4c20-b027-003b1c9b0a7b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:33:32.209732 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:32.209689    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6a68df1-2021-4c20-b027-003b1c9b0a7b-maas-api-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:33:32.865511 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:32.865467    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dbaf75b1-lxhxl" event={"ID":"e6a68df1-2021-4c20-b027-003b1c9b0a7b","Type":"ContainerDied","Data":"34d7edd6e1eb0afb639f4401bc730e124ef792fb78a92641fef3ae4a3c7d1e88"}
Sep 06 10:33:32.865685 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:32.865526    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34d7edd6e1eb0afb639f4401bc730e124ef792fb78a92641fef3ae4a3c7d1e88"
Sep 06 10:33:32.865685 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:32.865484    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dbaf75b1-lxhxl"
Sep 06 10:33:36.109402 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:36.109372    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:36.209451 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:36.209422    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:36.823498 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:36.823470    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4"
Sep 06 10:33:42.526586 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:42.526549    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:43.142518 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:43.142486    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:43.216862 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:43.216824    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:43.284911 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:43.284877    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:43.347898 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:43.347856    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dbaf75b1-lxhxl"]
Sep 06 10:33:43.349508 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:43.349483    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:43.350660 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:43.350634    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dbaf75b1-lxhxl"]
Sep 06 10:33:43.409856 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:43.409818    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:43.485833 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:43.485785    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"]
Sep 06 10:33:43.486300 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:43.486267    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4" podUID="1b68a9c7-d971-4f3d-af6f-3b551e9d1786" containerName="istio-proxy" containerID="cri-o://f68495d747b181fb6b4e54c5bf19742948fc11e94078c81c73338393a455eff4" gracePeriod=30
Sep 06 10:33:43.507905 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:43.507872    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:43.961332 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:43.961274    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:44.060365 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:44.060308    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:44.164894 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:44.164859    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:44.548611 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:44.548575    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:44.754084 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:44.754017    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6a68df1-2021-4c20-b027-003b1c9b0a7b" path="/var/lib/kubelet/pods/e6a68df1-2021-4c20-b027-003b1c9b0a7b/volumes"
Sep 06 10:33:44.943374 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:44.943342    2561 generic.go:356] "Generic (PLEG): container finished" podID="160689e4-3c5a-4be0-a457-de7df77fccb5" containerID="bfbc005034174a355fd563096e79905cc8abf92b087657b8b052d9b2f327d487" exitCode=0
Sep 06 10:33:44.943525 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:44.943351    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm" event={"ID":"160689e4-3c5a-4be0-a457-de7df77fccb5","Type":"ContainerDied","Data":"bfbc005034174a355fd563096e79905cc8abf92b087657b8b052d9b2f327d487"}
Sep 06 10:33:44.943817 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:44.943801    2561 scope.go:117] "RemoveContainer" containerID="bfbc005034174a355fd563096e79905cc8abf92b087657b8b052d9b2f327d487"
Sep 06 10:33:44.945040 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:44.945011    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:33:44.945101 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:44.945080    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:33:44.945137 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:44.945110    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:33:45.035062 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:45.035029    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:45.114383 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:45.114349    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:45.956346 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:45.956286    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm" event={"ID":"160689e4-3c5a-4be0-a457-de7df77fccb5","Type":"ContainerStarted","Data":"19dc179aed4657252bafc27fa4f2d2089bcc020ca3352e6ed895d401b38314cb"}
Sep 06 10:33:46.450183 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:46.450148    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:46.450793 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:46.450585    2561 patch_prober.go:28] interesting pod/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 06 10:33:46.450973 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:46.450950    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm" podUID="160689e4-3c5a-4be0-a457-de7df77fccb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 06 10:33:47.064566 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:47.064525    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:47.162072 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:47.162036    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:47.312082 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:47.312052    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:47.376103 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:47.376018    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:47.450801 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:47.450755    2561 patch_prober.go:28] interesting pod/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 06 10:33:47.451299 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:47.450849    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm" podUID="160689e4-3c5a-4be0-a457-de7df77fccb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 06 10:33:47.476080 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:47.476032    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:47.648814 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:47.648707    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:47.921575 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:47.921541    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:48.030129 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.030101    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:33:48.450642 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.450610    2561 patch_prober.go:28] interesting pod/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 06 10:33:48.450969 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.450915    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm" podUID="160689e4-3c5a-4be0-a457-de7df77fccb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 06 10:33:48.801509 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.801486    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:33:48.891425 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.891399    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-token\") pod \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") "
Sep 06 10:33:48.891606 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.891450    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-podinfo\") pod \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") "
Sep 06 10:33:48.891606 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.891478    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5rfj\" (UniqueName: \"kubernetes.io/projected/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-kube-api-access-v5rfj\") pod \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") "
Sep 06 10:33:48.891606 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.891528    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-envoy\") pod \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") "
Sep 06 10:33:48.891606 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.891559    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-workload-socket\") pod \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") "
Sep 06 10:33:48.891815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.891646    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-credential-socket\") pod \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") "
Sep 06 10:33:48.891815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.891688    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istiod-ca-cert\") pod \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") "
Sep 06 10:33:48.891815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.891723    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-workload-certs\") pod \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") "
Sep 06 10:33:48.892745 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.892432    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-data\") pod \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\" (UID: \"1b68a9c7-d971-4f3d-af6f-3b551e9d1786\") "
Sep 06 10:33:48.893049 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.892023    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1b68a9c7-d971-4f3d-af6f-3b551e9d1786" (UID: "1b68a9c7-d971-4f3d-af6f-3b551e9d1786"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:33:48.893049 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.892041    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1b68a9c7-d971-4f3d-af6f-3b551e9d1786" (UID: "1b68a9c7-d971-4f3d-af6f-3b551e9d1786"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:33:48.893049 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.892262    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1b68a9c7-d971-4f3d-af6f-3b551e9d1786" (UID: "1b68a9c7-d971-4f3d-af6f-3b551e9d1786"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:33:48.893049 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.892364    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1b68a9c7-d971-4f3d-af6f-3b551e9d1786" (UID: "1b68a9c7-d971-4f3d-af6f-3b551e9d1786"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:33:48.893049 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.892694    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-data" (OuterVolumeSpecName: "istio-data") pod "1b68a9c7-d971-4f3d-af6f-3b551e9d1786" (UID: "1b68a9c7-d971-4f3d-af6f-3b551e9d1786"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:33:48.893829 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.893807    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:33:48.893946 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.893915    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1b68a9c7-d971-4f3d-af6f-3b551e9d1786" (UID: "1b68a9c7-d971-4f3d-af6f-3b551e9d1786"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:33:48.894034 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.893940    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:33:48.894178 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.894165    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:33:48.894300 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.894285    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:33:48.894374 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.894305    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:33:48.894470 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.894443    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1b68a9c7-d971-4f3d-af6f-3b551e9d1786" (UID: "1b68a9c7-d971-4f3d-af6f-3b551e9d1786"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 10:33:48.894470 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.894461    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-kube-api-access-v5rfj" (OuterVolumeSpecName: "kube-api-access-v5rfj") pod "1b68a9c7-d971-4f3d-af6f-3b551e9d1786" (UID: "1b68a9c7-d971-4f3d-af6f-3b551e9d1786"). InnerVolumeSpecName "kube-api-access-v5rfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:33:48.894741 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.894717    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-token" (OuterVolumeSpecName: "istio-token") pod "1b68a9c7-d971-4f3d-af6f-3b551e9d1786" (UID: "1b68a9c7-d971-4f3d-af6f-3b551e9d1786"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:33:48.979365 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.979304    2561 generic.go:356] "Generic (PLEG): container finished" podID="1b68a9c7-d971-4f3d-af6f-3b551e9d1786" containerID="f68495d747b181fb6b4e54c5bf19742948fc11e94078c81c73338393a455eff4" exitCode=0
Sep 06 10:33:48.979365 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.979353    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4" event={"ID":"1b68a9c7-d971-4f3d-af6f-3b551e9d1786","Type":"ContainerDied","Data":"f68495d747b181fb6b4e54c5bf19742948fc11e94078c81c73338393a455eff4"}
Sep 06 10:33:48.979563 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.979382    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"
Sep 06 10:33:48.979563 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.979416    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4" event={"ID":"1b68a9c7-d971-4f3d-af6f-3b551e9d1786","Type":"ContainerDied","Data":"49d6b9288e32c87fe200fe1fc6cad2d29230743ca5b1eb1c35e92fd3b703fc8b"}
Sep 06 10:33:48.979563 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.979439    2561 scope.go:117] "RemoveContainer" containerID="f68495d747b181fb6b4e54c5bf19742948fc11e94078c81c73338393a455eff4"
Sep 06 10:33:48.989937 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.989922    2561 scope.go:117] "RemoveContainer" containerID="a81f13aaa01d2cff151c6424376231d4313186477566dea9b100b03527359bbd"
Sep 06 10:33:48.995283 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.995263    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:33:48.995283 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.995283    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:33:48.995425 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.995293    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5rfj\" (UniqueName: \"kubernetes.io/projected/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-kube-api-access-v5rfj\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:33:48.995425 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.995302    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b68a9c7-d971-4f3d-af6f-3b551e9d1786-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:33:49.000823 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.999208    2561 scope.go:117] "RemoveContainer" containerID="f68495d747b181fb6b4e54c5bf19742948fc11e94078c81c73338393a455eff4"
Sep 06 10:33:49.000823 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:33:48.999604    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f68495d747b181fb6b4e54c5bf19742948fc11e94078c81c73338393a455eff4\": container with ID starting with f68495d747b181fb6b4e54c5bf19742948fc11e94078c81c73338393a455eff4 not found: ID does not exist" containerID="f68495d747b181fb6b4e54c5bf19742948fc11e94078c81c73338393a455eff4"
Sep 06 10:33:49.000823 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.999633    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f68495d747b181fb6b4e54c5bf19742948fc11e94078c81c73338393a455eff4"} err="failed to get container status \"f68495d747b181fb6b4e54c5bf19742948fc11e94078c81c73338393a455eff4\": rpc error: code = NotFound desc = could not find container \"f68495d747b181fb6b4e54c5bf19742948fc11e94078c81c73338393a455eff4\": container with ID starting with f68495d747b181fb6b4e54c5bf19742948fc11e94078c81c73338393a455eff4 not found: ID does not exist"
Sep 06 10:33:49.000823 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.999656    2561 scope.go:117] "RemoveContainer" containerID="a81f13aaa01d2cff151c6424376231d4313186477566dea9b100b03527359bbd"
Sep 06 10:33:49.000823 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:33:48.999924    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a81f13aaa01d2cff151c6424376231d4313186477566dea9b100b03527359bbd\": container with ID starting with a81f13aaa01d2cff151c6424376231d4313186477566dea9b100b03527359bbd not found: ID does not exist" containerID="a81f13aaa01d2cff151c6424376231d4313186477566dea9b100b03527359bbd"
Sep 06 10:33:49.000823 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:48.999948    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a81f13aaa01d2cff151c6424376231d4313186477566dea9b100b03527359bbd"} err="failed to get container status \"a81f13aaa01d2cff151c6424376231d4313186477566dea9b100b03527359bbd\": rpc error: code = NotFound desc = could not find container \"a81f13aaa01d2cff151c6424376231d4313186477566dea9b100b03527359bbd\": container with ID starting with a81f13aaa01d2cff151c6424376231d4313186477566dea9b100b03527359bbd not found: ID does not exist"
Sep 06 10:33:49.008197 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:49.008173    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"]
Sep 06 10:33:49.012242 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:49.012220    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-dbaf75b1-openshift-default-6fbb7b9668-hpkg4"]
Sep 06 10:33:49.450493 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:49.450451    2561 patch_prober.go:28] interesting pod/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 06 10:33:49.450694 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:49.450524    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm" podUID="160689e4-3c5a-4be0-a457-de7df77fccb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 06 10:33:50.450549 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:50.450506    2561 patch_prober.go:28] interesting pod/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 06 10:33:50.451016 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:50.450594    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm" podUID="160689e4-3c5a-4be0-a457-de7df77fccb5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 06 10:33:50.759338 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:50.759232    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b68a9c7-d971-4f3d-af6f-3b551e9d1786" path="/var/lib/kubelet/pods/1b68a9c7-d971-4f3d-af6f-3b551e9d1786/volumes"
Sep 06 10:33:51.454117 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:51.454085    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:51.454478 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:51.454359    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:33:51.455048 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:33:51.455033    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:34:12.060277 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:12.060234    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ca3c8694-6qqdw"]
Sep 06 10:34:12.060902 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:12.060881    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6a68df1-2021-4c20-b027-003b1c9b0a7b" containerName="revoke-keys"
Sep 06 10:34:12.060902 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:12.060903    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6a68df1-2021-4c20-b027-003b1c9b0a7b" containerName="revoke-keys"
Sep 06 10:34:12.061031 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:12.060918    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b68a9c7-d971-4f3d-af6f-3b551e9d1786" containerName="istio-proxy"
Sep 06 10:34:12.061031 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:12.060927    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b68a9c7-d971-4f3d-af6f-3b551e9d1786" containerName="istio-proxy"
Sep 06 10:34:12.061031 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:12.060938    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b68a9c7-d971-4f3d-af6f-3b551e9d1786" containerName="istio-proxy"
Sep 06 10:34:12.061031 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:12.060949    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b68a9c7-d971-4f3d-af6f-3b551e9d1786" containerName="istio-proxy"
Sep 06 10:34:12.061227 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:12.061075    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6a68df1-2021-4c20-b027-003b1c9b0a7b" containerName="revoke-keys"
Sep 06 10:34:12.061227 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:12.061089    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b68a9c7-d971-4f3d-af6f-3b551e9d1786" containerName="istio-proxy"
Sep 06 10:34:12.061227 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:12.061100    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b68a9c7-d971-4f3d-af6f-3b551e9d1786" containerName="istio-proxy"
Sep 06 10:34:12.068037 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:12.068008    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ca3c8694-6qqdw"
Sep 06 10:34:12.070392 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:12.070365    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n5b2f\""
Sep 06 10:34:12.071498 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:12.071473    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ca3c8694-6qqdw"]
Sep 06 10:34:12.126800 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:12.126768    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/867641fa-7478-41b5-ba18-08b734a78488-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ca3c8694-6qqdw\" (UID: \"867641fa-7478-41b5-ba18-08b734a78488\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ca3c8694-6qqdw"
Sep 06 10:34:12.228001 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:12.227962    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/867641fa-7478-41b5-ba18-08b734a78488-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ca3c8694-6qqdw\" (UID: \"867641fa-7478-41b5-ba18-08b734a78488\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ca3c8694-6qqdw"
Sep 06 10:34:12.228605 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:12.228582    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/867641fa-7478-41b5-ba18-08b734a78488-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ca3c8694-6qqdw\" (UID: \"867641fa-7478-41b5-ba18-08b734a78488\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ca3c8694-6qqdw"
Sep 06 10:34:12.380166 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:12.380074    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ca3c8694-6qqdw"
Sep 06 10:34:12.654177 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:12.654152    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ca3c8694-6qqdw"]
Sep 06 10:34:12.655849 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:34:12.655825    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod867641fa_7478_41b5_ba18_08b734a78488.slice/crio-8656406e18382db25c0c5801c9e5903935e7e7bb39aef568d222236f07b9454e WatchSource:0}: Error finding container 8656406e18382db25c0c5801c9e5903935e7e7bb39aef568d222236f07b9454e: Status 404 returned error can't find the container with id 8656406e18382db25c0c5801c9e5903935e7e7bb39aef568d222236f07b9454e
Sep 06 10:34:13.127334 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:13.127286    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ca3c8694-6qqdw" event={"ID":"867641fa-7478-41b5-ba18-08b734a78488","Type":"ContainerStarted","Data":"b718b745ab0c8f0015af977348b0f0c18579ee24536fd6e8cb941601fa897d8f"}
Sep 06 10:34:13.127715 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:13.127363    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ca3c8694-6qqdw" event={"ID":"867641fa-7478-41b5-ba18-08b734a78488","Type":"ContainerStarted","Data":"8656406e18382db25c0c5801c9e5903935e7e7bb39aef568d222236f07b9454e"}
Sep 06 10:34:13.143206 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:13.143156    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ca3c8694-6qqdw" podStartSLOduration=1.143143081 podStartE2EDuration="1.143143081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:34:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:34:13.142343003 +0000 UTC m=+744.920762417" watchObservedRunningTime="2026-09-06 10:34:13.143143081 +0000 UTC m=+744.921562494"
Sep 06 10:34:14.144230 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:14.144193    2561 generic.go:356] "Generic (PLEG): container finished" podID="867641fa-7478-41b5-ba18-08b734a78488" containerID="b718b745ab0c8f0015af977348b0f0c18579ee24536fd6e8cb941601fa897d8f" exitCode=0
Sep 06 10:34:14.144647 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:14.144280    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ca3c8694-6qqdw" event={"ID":"867641fa-7478-41b5-ba18-08b734a78488","Type":"ContainerDied","Data":"b718b745ab0c8f0015af977348b0f0c18579ee24536fd6e8cb941601fa897d8f"}
Sep 06 10:34:15.290817 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:15.290795    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ca3c8694-6qqdw"
Sep 06 10:34:15.359563 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:15.359531    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/867641fa-7478-41b5-ba18-08b734a78488-maas-api-service-ca\") pod \"867641fa-7478-41b5-ba18-08b734a78488\" (UID: \"867641fa-7478-41b5-ba18-08b734a78488\") "
Sep 06 10:34:15.359904 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:15.359877    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/867641fa-7478-41b5-ba18-08b734a78488-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "867641fa-7478-41b5-ba18-08b734a78488" (UID: "867641fa-7478-41b5-ba18-08b734a78488"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:34:15.461312 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:15.461283    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/867641fa-7478-41b5-ba18-08b734a78488-maas-api-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:34:16.157749 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:16.157718    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ca3c8694-6qqdw"
Sep 06 10:34:16.157918 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:16.157749    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ca3c8694-6qqdw" event={"ID":"867641fa-7478-41b5-ba18-08b734a78488","Type":"ContainerDied","Data":"8656406e18382db25c0c5801c9e5903935e7e7bb39aef568d222236f07b9454e"}
Sep 06 10:34:16.157918 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:16.157796    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8656406e18382db25c0c5801c9e5903935e7e7bb39aef568d222236f07b9454e"
Sep 06 10:34:17.100902 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:17.100858    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:18.812619 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:18.812583    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:18.885522 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:18.885491    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:18.947085 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:18.947056    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:19.017808 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:19.017772    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ca3c8694-6qqdw"]
Sep 06 10:34:19.021879 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:19.021855    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:19.023142 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:19.023120    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ca3c8694-6qqdw"]
Sep 06 10:34:19.080578 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:19.080475    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:19.209198 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:19.209170    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:19.630931 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:19.630889    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:19.906368 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:19.906337    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"]
Sep 06 10:34:19.907267 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:19.907245    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="867641fa-7478-41b5-ba18-08b734a78488" containerName="revoke-keys"
Sep 06 10:34:19.907267 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:19.907269    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="867641fa-7478-41b5-ba18-08b734a78488" containerName="revoke-keys"
Sep 06 10:34:19.907466 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:19.907405    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="867641fa-7478-41b5-ba18-08b734a78488" containerName="revoke-keys"
Sep 06 10:34:19.910657 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:19.910636    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:19.913036 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:19.913015    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-17db6c23-openshift-default-dockercfg-pt6pc\""
Sep 06 10:34:19.921862 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:19.921834    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"]
Sep 06 10:34:19.939605 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:19.939572    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:20.008182 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.008142    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-workload-socket\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.008390 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.008201    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-podinfo\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.008474 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.008391    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-credential-socket\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.008474 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.008436    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-workload-certs\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.008596 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.008487    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istiod-ca-cert\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.008596 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.008514    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msmb2\" (UniqueName: \"kubernetes.io/projected/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-kube-api-access-msmb2\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.008596 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.008548    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-token\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.008596 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.008593    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-data\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.008806 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.008624    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-envoy\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.109543 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.109509    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-envoy\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.109737 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.109554    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-workload-socket\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.109737 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.109583    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-podinfo\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.109737 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.109682    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-credential-socket\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.109737 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.109711    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-workload-certs\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.109970 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.109752    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istiod-ca-cert\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.109970 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.109780    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msmb2\" (UniqueName: \"kubernetes.io/projected/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-kube-api-access-msmb2\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.109970 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.109813    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-token\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.109970 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.109860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-data\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.110186 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.110033    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-workload-socket\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.110186 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.110110    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-credential-socket\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.110318 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.110202    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-data\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.110318 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.110207    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-workload-certs\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.110857 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.110817    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istiod-ca-cert\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.112526 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.112503    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-envoy\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.112662 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.112645    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-podinfo\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.119495 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.119467    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-token\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.119580 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.119561    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msmb2\" (UniqueName: \"kubernetes.io/projected/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-kube-api-access-msmb2\") pod \"e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") " pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.223256 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.223194    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:20.484446 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.484304    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:20.499174 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.499148    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"]
Sep 06 10:34:20.500769 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:34:20.500728    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7aa9085_cbbe_44f8_85f4_b5e87f9c32bd.slice/crio-3b0b2ddfdee50d9cd5f8f8eb085eceb1274459a13d548989ecb3a38d797da530 WatchSource:0}: Error finding container 3b0b2ddfdee50d9cd5f8f8eb085eceb1274459a13d548989ecb3a38d797da530: Status 404 returned error can't find the container with id 3b0b2ddfdee50d9cd5f8f8eb085eceb1274459a13d548989ecb3a38d797da530
Sep 06 10:34:20.502971 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.502941    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:34:20.503045 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.503010    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:34:20.503045 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.503040    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:34:20.756107 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:20.756028    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="867641fa-7478-41b5-ba18-08b734a78488" path="/var/lib/kubelet/pods/867641fa-7478-41b5-ba18-08b734a78488/volumes"
Sep 06 10:34:21.194222 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:21.194189    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89" event={"ID":"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd","Type":"ContainerStarted","Data":"df37c951277d903ba82561a11559a898b520f1150198c311d420b88e2135be18"}
Sep 06 10:34:21.194603 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:21.194239    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89" event={"ID":"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd","Type":"ContainerStarted","Data":"3b0b2ddfdee50d9cd5f8f8eb085eceb1274459a13d548989ecb3a38d797da530"}
Sep 06 10:34:21.214777 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:21.214732    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89" podStartSLOduration=2.214716942 podStartE2EDuration="2.214716942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:34:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:34:21.213039646 +0000 UTC m=+752.991459060" watchObservedRunningTime="2026-09-06 10:34:21.214716942 +0000 UTC m=+752.993136354"
Sep 06 10:34:21.224306 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:21.224281    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:21.229396 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:21.229374    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:22.201221 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:22.201186    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:22.202228 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:22.202209    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:22.554869 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:22.554788    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:22.651793 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:22.651755    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:23.726042 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:23.726013    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:23.787551 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:23.787510    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:23.888477 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:23.888446    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:24.215124 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:24.215088    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:24.318838 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:24.318809    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:42.330116 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:42.330075    2561 generic.go:356] "Generic (PLEG): container finished" podID="f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" containerID="df37c951277d903ba82561a11559a898b520f1150198c311d420b88e2135be18" exitCode=0
Sep 06 10:34:42.330567 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:42.330151    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89" event={"ID":"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd","Type":"ContainerDied","Data":"df37c951277d903ba82561a11559a898b520f1150198c311d420b88e2135be18"}
Sep 06 10:34:42.330662 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:42.330647    2561 scope.go:117] "RemoveContainer" containerID="df37c951277d903ba82561a11559a898b520f1150198c311d420b88e2135be18"
Sep 06 10:34:42.331770 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:42.331740    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:34:42.331886 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:42.331830    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:34:42.331886 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:42.331877    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:34:43.341065 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:43.341024    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89" event={"ID":"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd","Type":"ContainerStarted","Data":"f5f56e769f4bd923b90021a1430823a1b16ea2f04850bfc2c05d687a93fb6a09"}
Sep 06 10:34:44.223476 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:44.223444    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:44.223665 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:44.223563    2561 patch_prober.go:28] interesting pod/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 06 10:34:44.223665 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:44.223617    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89" podUID="f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 06 10:34:45.223964 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:45.223927    2561 patch_prober.go:28] interesting pod/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 06 10:34:45.224385 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:45.223983    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89" podUID="f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 06 10:34:46.223620 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:46.223584    2561 patch_prober.go:28] interesting pod/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 06 10:34:46.223821 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:46.223640    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89" podUID="f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 06 10:34:47.224063 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:47.224020    2561 patch_prober.go:28] interesting pod/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 06 10:34:47.224473 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:47.224085    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89" podUID="f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 06 10:34:48.224394 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:48.224356    2561 patch_prober.go:28] interesting pod/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 06 10:34:48.224782 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:48.224415    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89" podUID="f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 06 10:34:48.271973 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:48.271930    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-17db6c23-ppgdj"]
Sep 06 10:34:48.276592 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:48.276566    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-17db6c23-ppgdj"
Sep 06 10:34:48.280823 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:48.280614    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n5b2f\""
Sep 06 10:34:48.282492 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:48.282469    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-17db6c23-ppgdj"]
Sep 06 10:34:48.406193 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:48.406156    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/debe922a-2479-461e-9204-60c840b9be80-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-17db6c23-ppgdj\" (UID: \"debe922a-2479-461e-9204-60c840b9be80\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-17db6c23-ppgdj"
Sep 06 10:34:48.506839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:48.506742    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/debe922a-2479-461e-9204-60c840b9be80-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-17db6c23-ppgdj\" (UID: \"debe922a-2479-461e-9204-60c840b9be80\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-17db6c23-ppgdj"
Sep 06 10:34:48.507439 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:48.507416    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/debe922a-2479-461e-9204-60c840b9be80-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-17db6c23-ppgdj\" (UID: \"debe922a-2479-461e-9204-60c840b9be80\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-17db6c23-ppgdj"
Sep 06 10:34:48.592390 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:48.592356    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-17db6c23-ppgdj"
Sep 06 10:34:48.865133 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:48.865099    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-17db6c23-ppgdj"]
Sep 06 10:34:48.865652 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:34:48.865621    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddebe922a_2479_461e_9204_60c840b9be80.slice/crio-ddd2d5ca17be6a988dcecc1d2d6f4bfdb01cbbb49cc42fed14eccf1596b5deef WatchSource:0}: Error finding container ddd2d5ca17be6a988dcecc1d2d6f4bfdb01cbbb49cc42fed14eccf1596b5deef: Status 404 returned error can't find the container with id ddd2d5ca17be6a988dcecc1d2d6f4bfdb01cbbb49cc42fed14eccf1596b5deef
Sep 06 10:34:49.228368 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:49.228312    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:49.228786 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:49.228642    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:49.229223 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:49.229206    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:34:49.393349 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:49.393234    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-17db6c23-ppgdj" event={"ID":"debe922a-2479-461e-9204-60c840b9be80","Type":"ContainerStarted","Data":"8c821a8e74866fbc8a7a20bd0dafe2a36d1c40fb1038c71e3e404022b55194b9"}
Sep 06 10:34:49.393349 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:49.393293    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-17db6c23-ppgdj" event={"ID":"debe922a-2479-461e-9204-60c840b9be80","Type":"ContainerStarted","Data":"ddd2d5ca17be6a988dcecc1d2d6f4bfdb01cbbb49cc42fed14eccf1596b5deef"}
Sep 06 10:34:49.410821 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:49.410778    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-17db6c23-ppgdj" podStartSLOduration=1.410763279 podStartE2EDuration="1.410763279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:34:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:34:49.408084939 +0000 UTC m=+781.186504353" watchObservedRunningTime="2026-09-06 10:34:49.410763279 +0000 UTC m=+781.189182692"
Sep 06 10:34:50.400524 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:50.400493    2561 generic.go:356] "Generic (PLEG): container finished" podID="debe922a-2479-461e-9204-60c840b9be80" containerID="8c821a8e74866fbc8a7a20bd0dafe2a36d1c40fb1038c71e3e404022b55194b9" exitCode=0
Sep 06 10:34:50.400915 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:50.400580    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-17db6c23-ppgdj" event={"ID":"debe922a-2479-461e-9204-60c840b9be80","Type":"ContainerDied","Data":"8c821a8e74866fbc8a7a20bd0dafe2a36d1c40fb1038c71e3e404022b55194b9"}
Sep 06 10:34:51.552628 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:51.552605    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-17db6c23-ppgdj"
Sep 06 10:34:51.634831 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:51.634805    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/debe922a-2479-461e-9204-60c840b9be80-maas-api-service-ca\") pod \"debe922a-2479-461e-9204-60c840b9be80\" (UID: \"debe922a-2479-461e-9204-60c840b9be80\") "
Sep 06 10:34:51.635169 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:51.635145    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/debe922a-2479-461e-9204-60c840b9be80-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "debe922a-2479-461e-9204-60c840b9be80" (UID: "debe922a-2479-461e-9204-60c840b9be80"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:34:51.736242 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:51.736162    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/debe922a-2479-461e-9204-60c840b9be80-maas-api-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:34:52.418218 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:52.418193    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-17db6c23-ppgdj"
Sep 06 10:34:52.418405 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:52.418237    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-17db6c23-ppgdj" event={"ID":"debe922a-2479-461e-9204-60c840b9be80","Type":"ContainerDied","Data":"ddd2d5ca17be6a988dcecc1d2d6f4bfdb01cbbb49cc42fed14eccf1596b5deef"}
Sep 06 10:34:52.418405 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:52.418284    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ddd2d5ca17be6a988dcecc1d2d6f4bfdb01cbbb49cc42fed14eccf1596b5deef"
Sep 06 10:34:53.217604 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:53.217572    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:54.364074 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:54.364039    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:54.431401 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:54.431366    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:54.491279 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:54.491245    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:54.571882 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:54.571849    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-17db6c23-ppgdj"]
Sep 06 10:34:54.573574 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:54.573539    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:54.574890 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:54.574871    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-17db6c23-ppgdj"]
Sep 06 10:34:54.631405 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:54.631341    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:54.754226 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:54.754192    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="debe922a-2479-461e-9204-60c840b9be80" path="/var/lib/kubelet/pods/debe922a-2479-461e-9204-60c840b9be80/volumes"
Sep 06 10:34:55.696751 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:55.696720    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"]
Sep 06 10:34:55.697148 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:55.696925    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89" podUID="f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" containerName="istio-proxy" containerID="cri-o://f5f56e769f4bd923b90021a1430823a1b16ea2f04850bfc2c05d687a93fb6a09" gracePeriod=30
Sep 06 10:34:55.710518 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:55.710491    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:56.134640 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.134558    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:56.414697 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.414664    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"]
Sep 06 10:34:56.415421 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.415401    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="debe922a-2479-461e-9204-60c840b9be80" containerName="revoke-keys"
Sep 06 10:34:56.415477 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.415425    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="debe922a-2479-461e-9204-60c840b9be80" containerName="revoke-keys"
Sep 06 10:34:56.415560 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.415547    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="debe922a-2479-461e-9204-60c840b9be80" containerName="revoke-keys"
Sep 06 10:34:56.419482 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.419461    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.422175 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.422157    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-7bb9997d-openshift-default-dockercfg-jwf46\""
Sep 06 10:34:56.427975 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.427951    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"]
Sep 06 10:34:56.442130 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.442102    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:56.584778 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.584728    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-istio-envoy\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.584932 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.584792    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-credential-socket\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.585002 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.584930    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-workload-socket\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.585046 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.584993    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6619e337-b789-4710-b784-e153c0cf81c9-istio-podinfo\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.585088 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.585054    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6619e337-b789-4710-b784-e153c0cf81c9-istiod-ca-cert\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.585131 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.585085    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-istio-data\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.585184 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.585124    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spxks\" (UniqueName: \"kubernetes.io/projected/6619e337-b789-4710-b784-e153c0cf81c9-kube-api-access-spxks\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.585247 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.585219    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-workload-certs\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.585304 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.585274    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6619e337-b789-4710-b784-e153c0cf81c9-istio-token\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.686062 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.685958    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-workload-socket\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.686062 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.686022    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6619e337-b789-4710-b784-e153c0cf81c9-istio-podinfo\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.686062 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.686063    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6619e337-b789-4710-b784-e153c0cf81c9-istiod-ca-cert\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.686375 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.686090    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-istio-data\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.686375 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.686123    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spxks\" (UniqueName: \"kubernetes.io/projected/6619e337-b789-4710-b784-e153c0cf81c9-kube-api-access-spxks\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.686528 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.686167    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-workload-certs\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.686681 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.686642    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6619e337-b789-4710-b784-e153c0cf81c9-istio-token\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.686804 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.686718    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-istio-envoy\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.686804 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.686753    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-credential-socket\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.686804 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.686782    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-workload-certs\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.686998 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.686521    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-workload-socket\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.686998 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.686548    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-istio-data\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.687123 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.687082    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-credential-socket\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.687184 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.687169    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6619e337-b789-4710-b784-e153c0cf81c9-istiod-ca-cert\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.689375 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.689056    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-istio-envoy\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.689375 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.689301    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6619e337-b789-4710-b784-e153c0cf81c9-istio-podinfo\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.694446 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.694412    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spxks\" (UniqueName: \"kubernetes.io/projected/6619e337-b789-4710-b784-e153c0cf81c9-kube-api-access-spxks\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.694643 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.694624    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6619e337-b789-4710-b784-e153c0cf81c9-istio-token\") pod \"e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") " pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.731820 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.731794    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:56.740906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:56.740875    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:57.022033 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:57.022000    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"]
Sep 06 10:34:57.023309 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:34:57.023278    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6619e337_b789_4710_b784_e153c0cf81c9.slice/crio-68e2e5693a45958251e676a4619dd6280f0f78bf53b00addc91faa418cab50e8 WatchSource:0}: Error finding container 68e2e5693a45958251e676a4619dd6280f0f78bf53b00addc91faa418cab50e8: Status 404 returned error can't find the container with id 68e2e5693a45958251e676a4619dd6280f0f78bf53b00addc91faa418cab50e8
Sep 06 10:34:57.025527 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:57.025499    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:34:57.025602 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:57.025563    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:34:57.025602 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:57.025590    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:34:57.454883 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:57.454849    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft" event={"ID":"6619e337-b789-4710-b784-e153c0cf81c9","Type":"ContainerStarted","Data":"e52039076c1f8c316b0c3b53f14e1950c6b94f81283e21d73ac75bd019419123"}
Sep 06 10:34:57.455075 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:57.454905    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft" event={"ID":"6619e337-b789-4710-b784-e153c0cf81c9","Type":"ContainerStarted","Data":"68e2e5693a45958251e676a4619dd6280f0f78bf53b00addc91faa418cab50e8"}
Sep 06 10:34:57.476860 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:57.476812    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft" podStartSLOduration=1.476795025 podStartE2EDuration="1.476795025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:34:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:34:57.47456797 +0000 UTC m=+789.252987383" watchObservedRunningTime="2026-09-06 10:34:57.476795025 +0000 UTC m=+789.255214437"
Sep 06 10:34:57.732666 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:57.732581    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:58.737898 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:58.737866    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:58.810733 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:58.810678    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:58.910084 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:58.910056    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:34:59.473388 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:59.473350    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:34:59.474371 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:34:59.474349    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:35:00.008787 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:00.008741    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:00.109926 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:00.109884    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:00.489770 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:00.489741    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:00.589189 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:00.589160    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:00.956757 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:00.956729    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:35:01.130355 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.130257    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istiod-ca-cert\") pod \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") "
Sep 06 10:35:01.130355 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.130355    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-podinfo\") pod \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") "
Sep 06 10:35:01.130874 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.130399    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msmb2\" (UniqueName: \"kubernetes.io/projected/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-kube-api-access-msmb2\") pod \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") "
Sep 06 10:35:01.130874 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.130419    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-workload-socket\") pod \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") "
Sep 06 10:35:01.130874 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.130462    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-credential-socket\") pod \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") "
Sep 06 10:35:01.130874 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.130580    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-envoy\") pod \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") "
Sep 06 10:35:01.130874 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.130648    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" (UID: "f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:35:01.130874 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.130737    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" (UID: "f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:35:01.130874 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.130747    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" (UID: "f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:35:01.130874 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.130672    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-data\") pod \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") "
Sep 06 10:35:01.130874 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.130861    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-data" (OuterVolumeSpecName: "istio-data") pod "f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" (UID: "f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:35:01.131361 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.130888    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-token\") pod \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") "
Sep 06 10:35:01.131361 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.130918    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-workload-certs\") pod \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\" (UID: \"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd\") "
Sep 06 10:35:01.131361 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.131195    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" (UID: "f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:35:01.131361 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.131312    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:01.131361 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.131345    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:01.131361 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.131358    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:01.131361 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.131366    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:01.131755 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.131375    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:01.132614 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.132588    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-kube-api-access-msmb2" (OuterVolumeSpecName: "kube-api-access-msmb2") pod "f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" (UID: "f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd"). InnerVolumeSpecName "kube-api-access-msmb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:35:01.132798 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.132774    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" (UID: "f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:35:01.133026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.133006    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" (UID: "f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 10:35:01.133084 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.133053    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-token" (OuterVolumeSpecName: "istio-token") pod "f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" (UID: "f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:35:01.232637 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.232588    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:01.232637 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.232632    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msmb2\" (UniqueName: \"kubernetes.io/projected/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-kube-api-access-msmb2\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:01.232637 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.232643    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:01.232637 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.232653    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:01.487680 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.487646    2561 generic.go:356] "Generic (PLEG): container finished" podID="f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" containerID="f5f56e769f4bd923b90021a1430823a1b16ea2f04850bfc2c05d687a93fb6a09" exitCode=0
Sep 06 10:35:01.487860 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.487686    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"
Sep 06 10:35:01.487860 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.487721    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89" event={"ID":"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd","Type":"ContainerDied","Data":"f5f56e769f4bd923b90021a1430823a1b16ea2f04850bfc2c05d687a93fb6a09"}
Sep 06 10:35:01.487860 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.487786    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89" event={"ID":"f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd","Type":"ContainerDied","Data":"3b0b2ddfdee50d9cd5f8f8eb085eceb1274459a13d548989ecb3a38d797da530"}
Sep 06 10:35:01.487860 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.487818    2561 scope.go:117] "RemoveContainer" containerID="f5f56e769f4bd923b90021a1430823a1b16ea2f04850bfc2c05d687a93fb6a09"
Sep 06 10:35:01.501381 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.499311    2561 scope.go:117] "RemoveContainer" containerID="df37c951277d903ba82561a11559a898b520f1150198c311d420b88e2135be18"
Sep 06 10:35:01.509483 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.509459    2561 scope.go:117] "RemoveContainer" containerID="f5f56e769f4bd923b90021a1430823a1b16ea2f04850bfc2c05d687a93fb6a09"
Sep 06 10:35:01.509784 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:35:01.509755    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5f56e769f4bd923b90021a1430823a1b16ea2f04850bfc2c05d687a93fb6a09\": container with ID starting with f5f56e769f4bd923b90021a1430823a1b16ea2f04850bfc2c05d687a93fb6a09 not found: ID does not exist" containerID="f5f56e769f4bd923b90021a1430823a1b16ea2f04850bfc2c05d687a93fb6a09"
Sep 06 10:35:01.509906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.509795    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5f56e769f4bd923b90021a1430823a1b16ea2f04850bfc2c05d687a93fb6a09"} err="failed to get container status \"f5f56e769f4bd923b90021a1430823a1b16ea2f04850bfc2c05d687a93fb6a09\": rpc error: code = NotFound desc = could not find container \"f5f56e769f4bd923b90021a1430823a1b16ea2f04850bfc2c05d687a93fb6a09\": container with ID starting with f5f56e769f4bd923b90021a1430823a1b16ea2f04850bfc2c05d687a93fb6a09 not found: ID does not exist"
Sep 06 10:35:01.509906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.509820    2561 scope.go:117] "RemoveContainer" containerID="df37c951277d903ba82561a11559a898b520f1150198c311d420b88e2135be18"
Sep 06 10:35:01.510107 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:35:01.510083    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df37c951277d903ba82561a11559a898b520f1150198c311d420b88e2135be18\": container with ID starting with df37c951277d903ba82561a11559a898b520f1150198c311d420b88e2135be18 not found: ID does not exist" containerID="df37c951277d903ba82561a11559a898b520f1150198c311d420b88e2135be18"
Sep 06 10:35:01.510197 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.510113    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df37c951277d903ba82561a11559a898b520f1150198c311d420b88e2135be18"} err="failed to get container status \"df37c951277d903ba82561a11559a898b520f1150198c311d420b88e2135be18\": rpc error: code = NotFound desc = could not find container \"df37c951277d903ba82561a11559a898b520f1150198c311d420b88e2135be18\": container with ID starting with df37c951277d903ba82561a11559a898b520f1150198c311d420b88e2135be18 not found: ID does not exist"
Sep 06 10:35:01.517633 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.517602    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"]
Sep 06 10:35:01.520245 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:01.520224    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-17db6c23-openshift-default-7fbf4fdd-45v89"]
Sep 06 10:35:02.755780 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:02.755730    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" path="/var/lib/kubelet/pods/f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd/volumes"
Sep 06 10:35:15.516486 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:15.516443    2561 patch_prober.go:28] interesting pod/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 10:35:15.516927 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:15.516524    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft" podUID="6619e337-b789-4710-b784-e153c0cf81c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 10:35:16.609860 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:16.609769    2561 generic.go:356] "Generic (PLEG): container finished" podID="6619e337-b789-4710-b784-e153c0cf81c9" containerID="e52039076c1f8c316b0c3b53f14e1950c6b94f81283e21d73ac75bd019419123" exitCode=0
Sep 06 10:35:16.610390 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:16.609846    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft" event={"ID":"6619e337-b789-4710-b784-e153c0cf81c9","Type":"ContainerDied","Data":"e52039076c1f8c316b0c3b53f14e1950c6b94f81283e21d73ac75bd019419123"}
Sep 06 10:35:16.610470 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:16.610420    2561 scope.go:117] "RemoveContainer" containerID="e52039076c1f8c316b0c3b53f14e1950c6b94f81283e21d73ac75bd019419123"
Sep 06 10:35:16.611512 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:16.611481    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:35:16.611609 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:16.611573    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:35:16.611653 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:16.611606    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:35:17.445967 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:17.443367    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:17.617480 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:17.617448    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft" event={"ID":"6619e337-b789-4710-b784-e153c0cf81c9","Type":"ContainerStarted","Data":"86ca1865aac76f61ba479a4566849140e88bd9760cc01b01caaf370176d31a2f"}
Sep 06 10:35:17.732914 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:17.732827    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:35:17.733088 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:17.733067    2561 patch_prober.go:28] interesting pod/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 06 10:35:17.733163 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:17.733124    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft" podUID="6619e337-b789-4710-b784-e153c0cf81c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 06 10:35:18.732372 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:18.732318    2561 patch_prober.go:28] interesting pod/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 06 10:35:18.732741 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:18.732392    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft" podUID="6619e337-b789-4710-b784-e153c0cf81c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 06 10:35:19.406728 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:19.406693    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:19.732529 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:19.732435    2561 patch_prober.go:28] interesting pod/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 06 10:35:19.732529 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:19.732500    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft" podUID="6619e337-b789-4710-b784-e153c0cf81c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 06 10:35:20.108870 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:20.108795    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:20.732433 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:20.732392    2561 patch_prober.go:28] interesting pod/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 06 10:35:20.732636 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:20.732460    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft" podUID="6619e337-b789-4710-b784-e153c0cf81c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 06 10:35:21.732504 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:21.732471    2561 patch_prober.go:28] interesting pod/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 06 10:35:21.732674 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:21.732532    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft" podUID="6619e337-b789-4710-b784-e153c0cf81c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 06 10:35:21.868240 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:21.868191    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:21.964426 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:21.964385    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5dda3d-llgw6"]
Sep 06 10:35:21.965148 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:21.965120    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" containerName="istio-proxy"
Sep 06 10:35:21.965148 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:21.965148    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" containerName="istio-proxy"
Sep 06 10:35:21.965365 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:21.965184    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" containerName="istio-proxy"
Sep 06 10:35:21.965365 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:21.965194    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" containerName="istio-proxy"
Sep 06 10:35:21.965365 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:21.965288    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" containerName="istio-proxy"
Sep 06 10:35:21.969093 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:21.969069    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5dda3d-llgw6"
Sep 06 10:35:21.972015 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:21.971988    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n5b2f\""
Sep 06 10:35:21.973404 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:21.973380    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5dda3d-llgw6"]
Sep 06 10:35:22.075168 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:22.075078    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23722b31-473c-4f6a-9e8c-9f240ca29227-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-5dda3d-llgw6\" (UID: \"23722b31-473c-4f6a-9e8c-9f240ca29227\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5dda3d-llgw6"
Sep 06 10:35:22.176756 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:22.176723    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23722b31-473c-4f6a-9e8c-9f240ca29227-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-5dda3d-llgw6\" (UID: \"23722b31-473c-4f6a-9e8c-9f240ca29227\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5dda3d-llgw6"
Sep 06 10:35:22.177417 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:22.177395    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23722b31-473c-4f6a-9e8c-9f240ca29227-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-5dda3d-llgw6\" (UID: \"23722b31-473c-4f6a-9e8c-9f240ca29227\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5dda3d-llgw6"
Sep 06 10:35:22.204653 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:22.204623    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:22.285194 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:22.285161    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5dda3d-llgw6"
Sep 06 10:35:22.576522 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:22.576496    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5dda3d-llgw6"]
Sep 06 10:35:22.578005 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:35:22.577977    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23722b31_473c_4f6a_9e8c_9f240ca29227.slice/crio-9c53d08978b2807862f849a3916f471c89e0bad6450c8467bf5c7d46ff7b0480 WatchSource:0}: Error finding container 9c53d08978b2807862f849a3916f471c89e0bad6450c8467bf5c7d46ff7b0480: Status 404 returned error can't find the container with id 9c53d08978b2807862f849a3916f471c89e0bad6450c8467bf5c7d46ff7b0480
Sep 06 10:35:22.664738 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:22.664696    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5dda3d-llgw6" event={"ID":"23722b31-473c-4f6a-9e8c-9f240ca29227","Type":"ContainerStarted","Data":"9c53d08978b2807862f849a3916f471c89e0bad6450c8467bf5c7d46ff7b0480"}
Sep 06 10:35:22.733038 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:22.733000    2561 patch_prober.go:28] interesting pod/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 06 10:35:22.733553 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:22.733081    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft" podUID="6619e337-b789-4710-b784-e153c0cf81c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 06 10:35:22.901383 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:22.901270    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:23.657918 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:23.657887    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7bb9997d-dxmnw"]
Sep 06 10:35:23.658398 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:23.658385    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7aa9085-cbbe-44f8-85f4-b5e87f9c32bd" containerName="istio-proxy"
Sep 06 10:35:23.661590 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:23.661573    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7bb9997d-dxmnw"
Sep 06 10:35:23.668630 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:23.668602    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7bb9997d-dxmnw"]
Sep 06 10:35:23.675087 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:23.675064    2561 generic.go:356] "Generic (PLEG): container finished" podID="23722b31-473c-4f6a-9e8c-9f240ca29227" containerID="7ccdccdb6a83691dd24f1b4cc04a098b206e8dcdb2d8411d03dce70f5c25f8d0" exitCode=0
Sep 06 10:35:23.675201 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:23.675152    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5dda3d-llgw6" event={"ID":"23722b31-473c-4f6a-9e8c-9f240ca29227","Type":"ContainerDied","Data":"7ccdccdb6a83691dd24f1b4cc04a098b206e8dcdb2d8411d03dce70f5c25f8d0"}
Sep 06 10:35:23.736232 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:23.736204    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:35:23.736658 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:23.736529    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:35:23.737220 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:23.737202    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:35:23.792566 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:23.792541    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e8116ca-8c8b-4c28-bd6e-cf263faaac4f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7bb9997d-dxmnw\" (UID: \"3e8116ca-8c8b-4c28-bd6e-cf263faaac4f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7bb9997d-dxmnw"
Sep 06 10:35:23.893787 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:23.893754    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e8116ca-8c8b-4c28-bd6e-cf263faaac4f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7bb9997d-dxmnw\" (UID: \"3e8116ca-8c8b-4c28-bd6e-cf263faaac4f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7bb9997d-dxmnw"
Sep 06 10:35:23.894347 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:23.894304    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e8116ca-8c8b-4c28-bd6e-cf263faaac4f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7bb9997d-dxmnw\" (UID: \"3e8116ca-8c8b-4c28-bd6e-cf263faaac4f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7bb9997d-dxmnw"
Sep 06 10:35:23.975614 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:23.975553    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7bb9997d-dxmnw"
Sep 06 10:35:24.261309 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:24.261277    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7bb9997d-dxmnw"]
Sep 06 10:35:24.261872 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:35:24.261841    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e8116ca_8c8b_4c28_bd6e_cf263faaac4f.slice/crio-b19b9e07d24816b42a02582da8eeac36aec94d5366687d2e1e8fda794656b8e2 WatchSource:0}: Error finding container b19b9e07d24816b42a02582da8eeac36aec94d5366687d2e1e8fda794656b8e2: Status 404 returned error can't find the container with id b19b9e07d24816b42a02582da8eeac36aec94d5366687d2e1e8fda794656b8e2
Sep 06 10:35:24.690665 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:24.690624    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7bb9997d-dxmnw" event={"ID":"3e8116ca-8c8b-4c28-bd6e-cf263faaac4f","Type":"ContainerStarted","Data":"7c07b4e92a318ce02604d7d4a0cac082172edabc69ec7d18cf86afba99aca9b3"}
Sep 06 10:35:24.690827 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:24.690723    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7bb9997d-dxmnw" event={"ID":"3e8116ca-8c8b-4c28-bd6e-cf263faaac4f","Type":"ContainerStarted","Data":"b19b9e07d24816b42a02582da8eeac36aec94d5366687d2e1e8fda794656b8e2"}
Sep 06 10:35:24.704482 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:24.704434    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7bb9997d-dxmnw" podStartSLOduration=1.7044164469999998 podStartE2EDuration="1.704416447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:35:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:35:24.704172327 +0000 UTC m=+816.482591741" watchObservedRunningTime="2026-09-06 10:35:24.704416447 +0000 UTC m=+816.482835862"
Sep 06 10:35:24.831314 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:24.831290    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5dda3d-llgw6"
Sep 06 10:35:25.006246 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:25.006213    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23722b31-473c-4f6a-9e8c-9f240ca29227-maas-api-service-ca\") pod \"23722b31-473c-4f6a-9e8c-9f240ca29227\" (UID: \"23722b31-473c-4f6a-9e8c-9f240ca29227\") "
Sep 06 10:35:25.006620 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:25.006593    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23722b31-473c-4f6a-9e8c-9f240ca29227-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "23722b31-473c-4f6a-9e8c-9f240ca29227" (UID: "23722b31-473c-4f6a-9e8c-9f240ca29227"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:35:25.107815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:25.107719    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23722b31-473c-4f6a-9e8c-9f240ca29227-maas-api-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:25.697712 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:25.697682    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5dda3d-llgw6"
Sep 06 10:35:25.697898 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:25.697720    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5dda3d-llgw6" event={"ID":"23722b31-473c-4f6a-9e8c-9f240ca29227","Type":"ContainerDied","Data":"9c53d08978b2807862f849a3916f471c89e0bad6450c8467bf5c7d46ff7b0480"}
Sep 06 10:35:25.697898 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:25.697768    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c53d08978b2807862f849a3916f471c89e0bad6450c8467bf5c7d46ff7b0480"
Sep 06 10:35:25.699374 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:25.699341    2561 generic.go:356] "Generic (PLEG): container finished" podID="3e8116ca-8c8b-4c28-bd6e-cf263faaac4f" containerID="7c07b4e92a318ce02604d7d4a0cac082172edabc69ec7d18cf86afba99aca9b3" exitCode=0
Sep 06 10:35:25.699524 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:25.699379    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7bb9997d-dxmnw" event={"ID":"3e8116ca-8c8b-4c28-bd6e-cf263faaac4f","Type":"ContainerDied","Data":"7c07b4e92a318ce02604d7d4a0cac082172edabc69ec7d18cf86afba99aca9b3"}
Sep 06 10:35:26.846443 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:26.846420    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7bb9997d-dxmnw"
Sep 06 10:35:27.027472 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:27.027370    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e8116ca-8c8b-4c28-bd6e-cf263faaac4f-maas-api-service-ca\") pod \"3e8116ca-8c8b-4c28-bd6e-cf263faaac4f\" (UID: \"3e8116ca-8c8b-4c28-bd6e-cf263faaac4f\") "
Sep 06 10:35:27.027740 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:27.027718    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e8116ca-8c8b-4c28-bd6e-cf263faaac4f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3e8116ca-8c8b-4c28-bd6e-cf263faaac4f" (UID: "3e8116ca-8c8b-4c28-bd6e-cf263faaac4f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:35:27.128854 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:27.128807    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e8116ca-8c8b-4c28-bd6e-cf263faaac4f-maas-api-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:27.712176 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:27.712143    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7bb9997d-dxmnw"
Sep 06 10:35:27.712367 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:27.712173    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7bb9997d-dxmnw" event={"ID":"3e8116ca-8c8b-4c28-bd6e-cf263faaac4f","Type":"ContainerDied","Data":"b19b9e07d24816b42a02582da8eeac36aec94d5366687d2e1e8fda794656b8e2"}
Sep 06 10:35:27.712367 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:27.712223    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b19b9e07d24816b42a02582da8eeac36aec94d5366687d2e1e8fda794656b8e2"
Sep 06 10:35:30.445385 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:30.445356    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:30.510349 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:30.510303    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:30.610985 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:30.610940    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:30.638915 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:30.638882    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7bb9997d-dxmnw"]
Sep 06 10:35:30.641544 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:30.641521    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7bb9997d-dxmnw"]
Sep 06 10:35:30.711642 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:30.711559    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:30.760371 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:30.760316    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e8116ca-8c8b-4c28-bd6e-cf263faaac4f" path="/var/lib/kubelet/pods/3e8116ca-8c8b-4c28-bd6e-cf263faaac4f/volumes"
Sep 06 10:35:30.773982 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:30.773950    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"]
Sep 06 10:35:30.774164 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:30.774146    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft" podUID="6619e337-b789-4710-b784-e153c0cf81c9" containerName="istio-proxy" containerID="cri-o://86ca1865aac76f61ba479a4566849140e88bd9760cc01b01caaf370176d31a2f" gracePeriod=30
Sep 06 10:35:30.802144 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:30.802118    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:31.445668 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:31.445633    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:31.547928 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:31.547899    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:31.646976 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:31.646945    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:32.233607 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:32.233578    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:32.873571 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:32.873537    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:32.911170 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:32.911138    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk"]
Sep 06 10:35:32.911432 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:32.911402    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk" podUID="023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb" containerName="payload-pre-processing" containerID="cri-o://12cd57553bb6592bd79818f43d80da0a0018e056b92385493eb54398b62bda92" gracePeriod=30
Sep 06 10:35:32.944058 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:32.944026    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:33.045512 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.045484    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:33.080294 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.080258    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5dda3d-llgw6"]
Sep 06 10:35:33.090720 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.089154    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-5dda3d-llgw6"]
Sep 06 10:35:33.110716 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.110679    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:33.173811 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.173786    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk"
Sep 06 10:35:33.190091 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.190011    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thtqr\" (UniqueName: \"kubernetes.io/projected/023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb-kube-api-access-thtqr\") pod \"023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb\" (UID: \"023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb\") "
Sep 06 10:35:33.190242 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.190164    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb-plugins-config-volume\") pod \"023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb\" (UID: \"023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb\") "
Sep 06 10:35:33.190651 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.190615    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb" (UID: "023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:35:33.192714 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.192684    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb-kube-api-access-thtqr" (OuterVolumeSpecName: "kube-api-access-thtqr") pod "023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb" (UID: "023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb"). InnerVolumeSpecName "kube-api-access-thtqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:35:33.291257 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.291227    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb-plugins-config-volume\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:33.291257 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.291251    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thtqr\" (UniqueName: \"kubernetes.io/projected/023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb-kube-api-access-thtqr\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:33.488311 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.488278    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:33.754202 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.754114    2561 generic.go:356] "Generic (PLEG): container finished" podID="023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb" containerID="12cd57553bb6592bd79818f43d80da0a0018e056b92385493eb54398b62bda92" exitCode=0
Sep 06 10:35:33.754202 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.754151    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk"
Sep 06 10:35:33.754202 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.754167    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk" event={"ID":"023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb","Type":"ContainerDied","Data":"12cd57553bb6592bd79818f43d80da0a0018e056b92385493eb54398b62bda92"}
Sep 06 10:35:33.754442 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.754211    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk" event={"ID":"023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb","Type":"ContainerDied","Data":"9086a3c76961fc23faeb92d43d7a2e7a98b725f071e0cda4e1b587d88112dd4d"}
Sep 06 10:35:33.754442 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.754237    2561 scope.go:117] "RemoveContainer" containerID="12cd57553bb6592bd79818f43d80da0a0018e056b92385493eb54398b62bda92"
Sep 06 10:35:33.763713 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.763695    2561 scope.go:117] "RemoveContainer" containerID="12cd57553bb6592bd79818f43d80da0a0018e056b92385493eb54398b62bda92"
Sep 06 10:35:33.763994 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:35:33.763973    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12cd57553bb6592bd79818f43d80da0a0018e056b92385493eb54398b62bda92\": container with ID starting with 12cd57553bb6592bd79818f43d80da0a0018e056b92385493eb54398b62bda92 not found: ID does not exist" containerID="12cd57553bb6592bd79818f43d80da0a0018e056b92385493eb54398b62bda92"
Sep 06 10:35:33.764062 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.764006    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12cd57553bb6592bd79818f43d80da0a0018e056b92385493eb54398b62bda92"} err="failed to get container status \"12cd57553bb6592bd79818f43d80da0a0018e056b92385493eb54398b62bda92\": rpc error: code = NotFound desc = could not find container \"12cd57553bb6592bd79818f43d80da0a0018e056b92385493eb54398b62bda92\": container with ID starting with 12cd57553bb6592bd79818f43d80da0a0018e056b92385493eb54398b62bda92 not found: ID does not exist"
Sep 06 10:35:33.777501 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.777476    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk"]
Sep 06 10:35:33.781227 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:33.781209    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-5dda3d-74f757d9c8-5bztk"]
Sep 06 10:35:34.755203 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:34.755167    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb" path="/var/lib/kubelet/pods/023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb/volumes"
Sep 06 10:35:34.755678 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:34.755606    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23722b31-473c-4f6a-9e8c-9f240ca29227" path="/var/lib/kubelet/pods/23722b31-473c-4f6a-9e8c-9f240ca29227/volumes"
Sep 06 10:35:36.034652 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.034626    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:35:36.113817 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.113743    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-istio-envoy\") pod \"6619e337-b789-4710-b784-e153c0cf81c9\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") "
Sep 06 10:35:36.113957 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.113822    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-credential-socket\") pod \"6619e337-b789-4710-b784-e153c0cf81c9\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") "
Sep 06 10:35:36.113957 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.113843    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-workload-socket\") pod \"6619e337-b789-4710-b784-e153c0cf81c9\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") "
Sep 06 10:35:36.113957 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.113861    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6619e337-b789-4710-b784-e153c0cf81c9-istiod-ca-cert\") pod \"6619e337-b789-4710-b784-e153c0cf81c9\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") "
Sep 06 10:35:36.113957 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.113919    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6619e337-b789-4710-b784-e153c0cf81c9-istio-token\") pod \"6619e337-b789-4710-b784-e153c0cf81c9\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") "
Sep 06 10:35:36.113957 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.113949    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6619e337-b789-4710-b784-e153c0cf81c9-istio-podinfo\") pod \"6619e337-b789-4710-b784-e153c0cf81c9\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") "
Sep 06 10:35:36.114258 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.113991    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spxks\" (UniqueName: \"kubernetes.io/projected/6619e337-b789-4710-b784-e153c0cf81c9-kube-api-access-spxks\") pod \"6619e337-b789-4710-b784-e153c0cf81c9\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") "
Sep 06 10:35:36.114258 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.114016    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-workload-certs\") pod \"6619e337-b789-4710-b784-e153c0cf81c9\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") "
Sep 06 10:35:36.114258 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.114123    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6619e337-b789-4710-b784-e153c0cf81c9" (UID: "6619e337-b789-4710-b784-e153c0cf81c9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:35:36.114258 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.114150    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6619e337-b789-4710-b784-e153c0cf81c9" (UID: "6619e337-b789-4710-b784-e153c0cf81c9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:35:36.114258 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.114175    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-istio-data\") pod \"6619e337-b789-4710-b784-e153c0cf81c9\" (UID: \"6619e337-b789-4710-b784-e153c0cf81c9\") "
Sep 06 10:35:36.114560 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.114284    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6619e337-b789-4710-b784-e153c0cf81c9" (UID: "6619e337-b789-4710-b784-e153c0cf81c9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:35:36.114560 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.114447    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-istio-data" (OuterVolumeSpecName: "istio-data") pod "6619e337-b789-4710-b784-e153c0cf81c9" (UID: "6619e337-b789-4710-b784-e153c0cf81c9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:35:36.114560 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.114466    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6619e337-b789-4710-b784-e153c0cf81c9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6619e337-b789-4710-b784-e153c0cf81c9" (UID: "6619e337-b789-4710-b784-e153c0cf81c9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:35:36.114721 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.114587    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:36.114721 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.114600    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:36.114721 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.114613    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6619e337-b789-4710-b784-e153c0cf81c9-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:36.114721 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.114625    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:36.114721 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.114634    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:36.116081 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.116055    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6619e337-b789-4710-b784-e153c0cf81c9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6619e337-b789-4710-b784-e153c0cf81c9" (UID: "6619e337-b789-4710-b784-e153c0cf81c9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 10:35:36.116241 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.116228    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6619e337-b789-4710-b784-e153c0cf81c9-istio-token" (OuterVolumeSpecName: "istio-token") pod "6619e337-b789-4710-b784-e153c0cf81c9" (UID: "6619e337-b789-4710-b784-e153c0cf81c9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:35:36.116546 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.116521    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6619e337-b789-4710-b784-e153c0cf81c9" (UID: "6619e337-b789-4710-b784-e153c0cf81c9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:35:36.116649 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.116556    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6619e337-b789-4710-b784-e153c0cf81c9-kube-api-access-spxks" (OuterVolumeSpecName: "kube-api-access-spxks") pod "6619e337-b789-4710-b784-e153c0cf81c9" (UID: "6619e337-b789-4710-b784-e153c0cf81c9"). InnerVolumeSpecName "kube-api-access-spxks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:35:36.216127 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.216095    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6619e337-b789-4710-b784-e153c0cf81c9-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:36.216127 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.216125    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6619e337-b789-4710-b784-e153c0cf81c9-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:36.216127 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.216134    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6619e337-b789-4710-b784-e153c0cf81c9-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:36.216387 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.216143    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spxks\" (UniqueName: \"kubernetes.io/projected/6619e337-b789-4710-b784-e153c0cf81c9-kube-api-access-spxks\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:35:36.774078 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.774048    2561 generic.go:356] "Generic (PLEG): container finished" podID="6619e337-b789-4710-b784-e153c0cf81c9" containerID="86ca1865aac76f61ba479a4566849140e88bd9760cc01b01caaf370176d31a2f" exitCode=0
Sep 06 10:35:36.774209 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.774096    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"
Sep 06 10:35:36.774209 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.774129    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft" event={"ID":"6619e337-b789-4710-b784-e153c0cf81c9","Type":"ContainerDied","Data":"86ca1865aac76f61ba479a4566849140e88bd9760cc01b01caaf370176d31a2f"}
Sep 06 10:35:36.774209 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.774183    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft" event={"ID":"6619e337-b789-4710-b784-e153c0cf81c9","Type":"ContainerDied","Data":"68e2e5693a45958251e676a4619dd6280f0f78bf53b00addc91faa418cab50e8"}
Sep 06 10:35:36.774209 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.774206    2561 scope.go:117] "RemoveContainer" containerID="86ca1865aac76f61ba479a4566849140e88bd9760cc01b01caaf370176d31a2f"
Sep 06 10:35:36.783607 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.783591    2561 scope.go:117] "RemoveContainer" containerID="e52039076c1f8c316b0c3b53f14e1950c6b94f81283e21d73ac75bd019419123"
Sep 06 10:35:36.791572 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.791549    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"]
Sep 06 10:35:36.792378 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.792335    2561 scope.go:117] "RemoveContainer" containerID="86ca1865aac76f61ba479a4566849140e88bd9760cc01b01caaf370176d31a2f"
Sep 06 10:35:36.792776 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:35:36.792666    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86ca1865aac76f61ba479a4566849140e88bd9760cc01b01caaf370176d31a2f\": container with ID starting with 86ca1865aac76f61ba479a4566849140e88bd9760cc01b01caaf370176d31a2f not found: ID does not exist" containerID="86ca1865aac76f61ba479a4566849140e88bd9760cc01b01caaf370176d31a2f"
Sep 06 10:35:36.792776 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.792697    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86ca1865aac76f61ba479a4566849140e88bd9760cc01b01caaf370176d31a2f"} err="failed to get container status \"86ca1865aac76f61ba479a4566849140e88bd9760cc01b01caaf370176d31a2f\": rpc error: code = NotFound desc = could not find container \"86ca1865aac76f61ba479a4566849140e88bd9760cc01b01caaf370176d31a2f\": container with ID starting with 86ca1865aac76f61ba479a4566849140e88bd9760cc01b01caaf370176d31a2f not found: ID does not exist"
Sep 06 10:35:36.792776 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.792720    2561 scope.go:117] "RemoveContainer" containerID="e52039076c1f8c316b0c3b53f14e1950c6b94f81283e21d73ac75bd019419123"
Sep 06 10:35:36.793180 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:35:36.793155    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e52039076c1f8c316b0c3b53f14e1950c6b94f81283e21d73ac75bd019419123\": container with ID starting with e52039076c1f8c316b0c3b53f14e1950c6b94f81283e21d73ac75bd019419123 not found: ID does not exist" containerID="e52039076c1f8c316b0c3b53f14e1950c6b94f81283e21d73ac75bd019419123"
Sep 06 10:35:36.793263 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.793187    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e52039076c1f8c316b0c3b53f14e1950c6b94f81283e21d73ac75bd019419123"} err="failed to get container status \"e52039076c1f8c316b0c3b53f14e1950c6b94f81283e21d73ac75bd019419123\": rpc error: code = NotFound desc = could not find container \"e52039076c1f8c316b0c3b53f14e1950c6b94f81283e21d73ac75bd019419123\": container with ID starting with e52039076c1f8c316b0c3b53f14e1950c6b94f81283e21d73ac75bd019419123 not found: ID does not exist"
Sep 06 10:35:36.795761 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:36.795743    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-7bb9997d-openshift-default-7cd6cc6496-ll5ft"]
Sep 06 10:35:38.405506 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:38.405460    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:38.755201 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:38.755128    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6619e337-b789-4710-b784-e153c0cf81c9" path="/var/lib/kubelet/pods/6619e337-b789-4710-b784-e153c0cf81c9/volumes"
Sep 06 10:35:39.091632 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:39.091556    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:39.149414 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:39.149384    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:39.236515 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:39.236467    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:39.327385 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:39.327358    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:39.427946 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:39.427919    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:39.794603 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:39.794513    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:39.987242 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:39.987210    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:40.088511 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:40.088433    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:40.261565 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:40.261532    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:40.715281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:40.715252    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:41.018527 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:41.018441    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:41.702445 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:41.702413    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:44.078251 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:44.078215    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:44.170845 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:44.170816    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:45.254692 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:45.254653    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:45.357131 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:45.357098    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:45.456452 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:45.456414    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:45.745527 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:45.745497    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:35:45.813160 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:35:45.813131    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:05.758085 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:05.758046    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:09.030518 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:09.030481    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:11.873652 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:11.873610    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:11.981522 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:11.981480    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:12.073771 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:12.073733    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:17.516806 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:17.516777    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:27.955793 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:27.955709    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:30.731618 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:30.731584    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:34.974102 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:34.974063    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:35.079054 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:35.079020    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:35.168852 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:35.168810    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:41.520490 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.520400    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:41.631280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.631241    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6c8f35-zf6wj"]
Sep 06 10:36:41.631723 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.631705    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb" containerName="payload-pre-processing"
Sep 06 10:36:41.631777 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.631726    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb" containerName="payload-pre-processing"
Sep 06 10:36:41.631777 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.631747    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23722b31-473c-4f6a-9e8c-9f240ca29227" containerName="revoke-keys"
Sep 06 10:36:41.631777 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.631753    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="23722b31-473c-4f6a-9e8c-9f240ca29227" containerName="revoke-keys"
Sep 06 10:36:41.631777 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.631763    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6619e337-b789-4710-b784-e153c0cf81c9" containerName="istio-proxy"
Sep 06 10:36:41.631901 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.631778    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6619e337-b789-4710-b784-e153c0cf81c9" containerName="istio-proxy"
Sep 06 10:36:41.631901 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.631798    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e8116ca-8c8b-4c28-bd6e-cf263faaac4f" containerName="revoke-keys"
Sep 06 10:36:41.631901 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.631804    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e8116ca-8c8b-4c28-bd6e-cf263faaac4f" containerName="revoke-keys"
Sep 06 10:36:41.631901 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.631895    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e8116ca-8c8b-4c28-bd6e-cf263faaac4f" containerName="revoke-keys"
Sep 06 10:36:41.632035 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.631903    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6619e337-b789-4710-b784-e153c0cf81c9" containerName="istio-proxy"
Sep 06 10:36:41.632035 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.631915    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="023ff6c2-fcb8-4aae-902a-f7c69f9ae3eb" containerName="payload-pre-processing"
Sep 06 10:36:41.632035 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.631921    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="23722b31-473c-4f6a-9e8c-9f240ca29227" containerName="revoke-keys"
Sep 06 10:36:41.635276 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.635244    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6c8f35-zf6wj"
Sep 06 10:36:41.641161 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.641138    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n5b2f\""
Sep 06 10:36:41.651419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.651390    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6c8f35-zf6wj"]
Sep 06 10:36:41.742072 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.742031    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e447b137-2e78-49c0-9df1-0dc0305251d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-6c8f35-zf6wj\" (UID: \"e447b137-2e78-49c0-9df1-0dc0305251d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6c8f35-zf6wj"
Sep 06 10:36:41.843180 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.843087    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e447b137-2e78-49c0-9df1-0dc0305251d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-6c8f35-zf6wj\" (UID: \"e447b137-2e78-49c0-9df1-0dc0305251d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6c8f35-zf6wj"
Sep 06 10:36:41.843818 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.843788    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e447b137-2e78-49c0-9df1-0dc0305251d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-6c8f35-zf6wj\" (UID: \"e447b137-2e78-49c0-9df1-0dc0305251d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6c8f35-zf6wj"
Sep 06 10:36:41.945190 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:41.945149    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6c8f35-zf6wj"
Sep 06 10:36:42.220027 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:42.219998    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6c8f35-zf6wj"]
Sep 06 10:36:42.221093 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:36:42.221067    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode447b137_2e78_49c0_9df1_0dc0305251d5.slice/crio-2c20070e5cb8a9e693430acffb22c06c6914da3d2a6c513aa57b8531024b97a6 WatchSource:0}: Error finding container 2c20070e5cb8a9e693430acffb22c06c6914da3d2a6c513aa57b8531024b97a6: Status 404 returned error can't find the container with id 2c20070e5cb8a9e693430acffb22c06c6914da3d2a6c513aa57b8531024b97a6
Sep 06 10:36:43.183147 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:43.183115    2561 generic.go:356] "Generic (PLEG): container finished" podID="e447b137-2e78-49c0-9df1-0dc0305251d5" containerID="9173385629dfb036dcb7e3a9196bae80297ee697cf26093b12919cb0f74d2c6d" exitCode=0
Sep 06 10:36:43.183549 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:43.183203    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6c8f35-zf6wj" event={"ID":"e447b137-2e78-49c0-9df1-0dc0305251d5","Type":"ContainerDied","Data":"9173385629dfb036dcb7e3a9196bae80297ee697cf26093b12919cb0f74d2c6d"}
Sep 06 10:36:43.183549 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:43.183252    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6c8f35-zf6wj" event={"ID":"e447b137-2e78-49c0-9df1-0dc0305251d5","Type":"ContainerStarted","Data":"2c20070e5cb8a9e693430acffb22c06c6914da3d2a6c513aa57b8531024b97a6"}
Sep 06 10:36:44.332659 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:44.332634    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6c8f35-zf6wj"
Sep 06 10:36:44.470361 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:44.470251    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e447b137-2e78-49c0-9df1-0dc0305251d5-maas-api-service-ca\") pod \"e447b137-2e78-49c0-9df1-0dc0305251d5\" (UID: \"e447b137-2e78-49c0-9df1-0dc0305251d5\") "
Sep 06 10:36:44.470663 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:44.470631    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e447b137-2e78-49c0-9df1-0dc0305251d5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e447b137-2e78-49c0-9df1-0dc0305251d5" (UID: "e447b137-2e78-49c0-9df1-0dc0305251d5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:36:44.571183 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:44.571140    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e447b137-2e78-49c0-9df1-0dc0305251d5-maas-api-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:36:45.196202 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:45.196172    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6c8f35-zf6wj"
Sep 06 10:36:45.196202 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:45.196187    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6c8f35-zf6wj" event={"ID":"e447b137-2e78-49c0-9df1-0dc0305251d5","Type":"ContainerDied","Data":"2c20070e5cb8a9e693430acffb22c06c6914da3d2a6c513aa57b8531024b97a6"}
Sep 06 10:36:45.196426 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:45.196231    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c20070e5cb8a9e693430acffb22c06c6914da3d2a6c513aa57b8531024b97a6"
Sep 06 10:36:45.646412 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:45.646310    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:46.409373 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:46.409309    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:48.735655 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:48.735628    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/1.log"
Sep 06 10:36:48.736578 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:48.736558    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/1.log"
Sep 06 10:36:48.740250 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:48.740235    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsw6t_a4733769-37b3-443b-9ee5-d93bd5f167f0/ovn-acl-logging/0.log"
Sep 06 10:36:48.741225 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:48.741207    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsw6t_a4733769-37b3-443b-9ee5-d93bd5f167f0/ovn-acl-logging/0.log"
Sep 06 10:36:52.094120 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:52.094087    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:52.190561 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:52.190528    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:52.265980 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:52.265945    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:52.366572 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:52.366486    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:52.449995 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:52.449954    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6c8f35-zf6wj"]
Sep 06 10:36:52.454867 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:52.454843    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:52.457379 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:52.457353    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-6c8f35-zf6wj"]
Sep 06 10:36:52.513676 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:52.513647    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:52.755250 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:52.755209    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e447b137-2e78-49c0-9df1-0dc0305251d5" path="/var/lib/kubelet/pods/e447b137-2e78-49c0-9df1-0dc0305251d5/volumes"
Sep 06 10:36:52.808065 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:52.808035    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:53.017761 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:53.017682    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:53.141399 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:53.141354    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:53.271660 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:53.271580    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:54.716462 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:54.716430    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:36:57.825112 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:36:57.825079    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:00.372974 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:00.372943    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:00.473449 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:00.473417    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:01.041110 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:01.041076    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:03.739686 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:03.739652    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:03.982032 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:03.982002    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:04.425161 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:04.425125    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:04.734512 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:04.734429    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:05.151291 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:05.151199    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:06.009693 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:06.009660    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:06.105362 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:06.105307    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:06.204813 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:06.204779    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:07.007238 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.007200    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:07.063558 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.063523    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:07.209472 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.209421    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:07.312906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.312803    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:07.440670 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.440636    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:07.745274 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.745238    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"]
Sep 06 10:37:07.745733 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.745717    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e447b137-2e78-49c0-9df1-0dc0305251d5" containerName="revoke-keys"
Sep 06 10:37:07.745733 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.745733    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e447b137-2e78-49c0-9df1-0dc0305251d5" containerName="revoke-keys"
Sep 06 10:37:07.745859 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.745752    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6619e337-b789-4710-b784-e153c0cf81c9" containerName="istio-proxy"
Sep 06 10:37:07.745859 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.745758    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6619e337-b789-4710-b784-e153c0cf81c9" containerName="istio-proxy"
Sep 06 10:37:07.745859 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.745826    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e447b137-2e78-49c0-9df1-0dc0305251d5" containerName="revoke-keys"
Sep 06 10:37:07.745859 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.745838    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6619e337-b789-4710-b784-e153c0cf81c9" containerName="istio-proxy"
Sep 06 10:37:07.753394 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.750657    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.755635 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.755612    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f3881d63-openshift-default-dockercfg-k5lqj\""
Sep 06 10:37:07.761040 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.761014    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"]
Sep 06 10:37:07.774281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.774257    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:07.793696 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.793670    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2301b15-52d3-4529-ab00-955235f8fe12-istio-token\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.793826 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.793708    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-workload-socket\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.793826 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.793736    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-istio-data\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.793826 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.793809    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2301b15-52d3-4529-ab00-955235f8fe12-istiod-ca-cert\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.793949 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.793849    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2301b15-52d3-4529-ab00-955235f8fe12-istio-podinfo\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.793949 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.793872    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-istio-envoy\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.793949 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.793909    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdlfz\" (UniqueName: \"kubernetes.io/projected/b2301b15-52d3-4529-ab00-955235f8fe12-kube-api-access-xdlfz\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.793949 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.793933    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-credential-socket\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.794094 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.793949    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-workload-certs\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.895564 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.895527    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2301b15-52d3-4529-ab00-955235f8fe12-istio-token\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.895564 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.895571    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-workload-socket\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.895800 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.895698    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-istio-data\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.895800 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.895739    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2301b15-52d3-4529-ab00-955235f8fe12-istiod-ca-cert\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.895800 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.895791    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2301b15-52d3-4529-ab00-955235f8fe12-istio-podinfo\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.896038 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.895817    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-istio-envoy\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.896038 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.895858    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdlfz\" (UniqueName: \"kubernetes.io/projected/b2301b15-52d3-4529-ab00-955235f8fe12-kube-api-access-xdlfz\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.896038 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.895896    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-credential-socket\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.896038 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.895983    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-workload-socket\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.896239 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.896096    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-istio-data\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.896239 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.896108    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-workload-certs\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.896239 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.896187    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-credential-socket\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.896401 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.896360    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-workload-certs\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.896558 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.896529    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2301b15-52d3-4529-ab00-955235f8fe12-istiod-ca-cert\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.898212 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.898186    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-istio-envoy\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.898454 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.898434    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2301b15-52d3-4529-ab00-955235f8fe12-istio-podinfo\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.903237 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.903217    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2301b15-52d3-4529-ab00-955235f8fe12-istio-token\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:07.903515 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:07.903489    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdlfz\" (UniqueName: \"kubernetes.io/projected/b2301b15-52d3-4529-ab00-955235f8fe12-kube-api-access-xdlfz\") pod \"e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") " pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:08.068310 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:08.068148    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:08.116560 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:08.116526    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:08.349870 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:08.349837    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"]
Sep 06 10:37:08.350923 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:37:08.350897    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2301b15_52d3_4529_ab00_955235f8fe12.slice/crio-5851684f2f9c51586e7e4f071abd116535ca8c4e63ea23b50512789d37f57ca7 WatchSource:0}: Error finding container 5851684f2f9c51586e7e4f071abd116535ca8c4e63ea23b50512789d37f57ca7: Status 404 returned error can't find the container with id 5851684f2f9c51586e7e4f071abd116535ca8c4e63ea23b50512789d37f57ca7
Sep 06 10:37:08.353306 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:08.353277    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:37:08.353420 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:08.353377    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:37:08.353491 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:08.353428    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:37:09.346481 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:09.346447    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7" event={"ID":"b2301b15-52d3-4529-ab00-955235f8fe12","Type":"ContainerStarted","Data":"7b1215caab66be9785640f4fc4e2b8a76694807b876069c190a5628222b8a293"}
Sep 06 10:37:09.346643 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:09.346506    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7" event={"ID":"b2301b15-52d3-4529-ab00-955235f8fe12","Type":"ContainerStarted","Data":"5851684f2f9c51586e7e4f071abd116535ca8c4e63ea23b50512789d37f57ca7"}
Sep 06 10:37:09.365310 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:09.365260    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7" podStartSLOduration=2.365244632 podStartE2EDuration="2.365244632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:37:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:37:09.364437852 +0000 UTC m=+921.142857264" watchObservedRunningTime="2026-09-06 10:37:09.365244632 +0000 UTC m=+921.143664045"
Sep 06 10:37:10.068933 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:10.068894    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:10.074116 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:10.074084    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:10.353819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:10.353727    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:10.354792 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:10.354772    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:10.904140 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:10.904092    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:11.260955 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:11.260841    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:11.360823 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:11.360793    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:12.422187 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:12.422143    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:12.523817 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:12.523773    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:12.684262 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:12.684176    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:12.922983 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:12.922926    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:13.018733 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:13.018648    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:16.981405 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:16.981372    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:31.499313 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:31.499278    2561 generic.go:356] "Generic (PLEG): container finished" podID="b2301b15-52d3-4529-ab00-955235f8fe12" containerID="7b1215caab66be9785640f4fc4e2b8a76694807b876069c190a5628222b8a293" exitCode=0
Sep 06 10:37:31.499751 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:31.499369    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7" event={"ID":"b2301b15-52d3-4529-ab00-955235f8fe12","Type":"ContainerDied","Data":"7b1215caab66be9785640f4fc4e2b8a76694807b876069c190a5628222b8a293"}
Sep 06 10:37:31.499856 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:31.499841    2561 scope.go:117] "RemoveContainer" containerID="7b1215caab66be9785640f4fc4e2b8a76694807b876069c190a5628222b8a293"
Sep 06 10:37:31.500992 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:31.500967    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:37:31.501051 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:31.501030    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:37:31.501094 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:31.501080    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:37:32.507891 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:32.507855    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7" event={"ID":"b2301b15-52d3-4529-ab00-955235f8fe12","Type":"ContainerStarted","Data":"06494df996b6cdbd7990e00bb1d401c47278142c9564de29c293cce584f65f53"}
Sep 06 10:37:33.068539 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:33.068494    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:33.068809 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:33.068784    2561 patch_prober.go:28] interesting pod/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 06 10:37:33.068900 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:33.068841    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7" podUID="b2301b15-52d3-4529-ab00-955235f8fe12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 06 10:37:34.069564 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:34.069527    2561 patch_prober.go:28] interesting pod/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 06 10:37:34.069949 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:34.069586    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7" podUID="b2301b15-52d3-4529-ab00-955235f8fe12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 06 10:37:35.069499 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:35.069460    2561 patch_prober.go:28] interesting pod/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 06 10:37:35.069694 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:35.069529    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7" podUID="b2301b15-52d3-4529-ab00-955235f8fe12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 06 10:37:36.068704 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:36.068669    2561 patch_prober.go:28] interesting pod/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 06 10:37:36.068889 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:36.068739    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7" podUID="b2301b15-52d3-4529-ab00-955235f8fe12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 06 10:37:36.246061 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:36.246026    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:36.890008 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:36.889966    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:36.984765 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:36.984730    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:37.068960 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:37.068925    2561 patch_prober.go:28] interesting pod/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Sep 06 10:37:37.069168 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:37.068985    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7" podUID="b2301b15-52d3-4529-ab00-955235f8fe12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Sep 06 10:37:37.306429 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:37.306393    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:38.073272 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:38.073240    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:38.073559 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:38.073536    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:38.074127 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:38.074110    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:37:43.171342 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:43.171282    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:43.271529 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:43.271494    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:43.531134 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:43.531045    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f3881d63-6xkhn"]
Sep 06 10:37:43.535387 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:43.535363    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f3881d63-6xkhn"
Sep 06 10:37:43.537668 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:43.537646    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n5b2f\""
Sep 06 10:37:43.542680 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:43.542655    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f3881d63-6xkhn"]
Sep 06 10:37:43.560921 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:43.560881    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/96d83cab-d8cb-4ad7-9b45-7322e99ca260-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f3881d63-6xkhn\" (UID: \"96d83cab-d8cb-4ad7-9b45-7322e99ca260\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f3881d63-6xkhn"
Sep 06 10:37:43.662027 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:43.661991    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/96d83cab-d8cb-4ad7-9b45-7322e99ca260-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f3881d63-6xkhn\" (UID: \"96d83cab-d8cb-4ad7-9b45-7322e99ca260\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f3881d63-6xkhn"
Sep 06 10:37:43.662845 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:43.662816    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/96d83cab-d8cb-4ad7-9b45-7322e99ca260-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-f3881d63-6xkhn\" (UID: \"96d83cab-d8cb-4ad7-9b45-7322e99ca260\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f3881d63-6xkhn"
Sep 06 10:37:43.799360 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:43.799234    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:43.847826 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:43.847787    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f3881d63-6xkhn"
Sep 06 10:37:44.135068 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:44.135034    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f3881d63-6xkhn"]
Sep 06 10:37:44.136762 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:37:44.136728    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96d83cab_d8cb_4ad7_9b45_7322e99ca260.slice/crio-591c0bb6fbea77bec6a848933d5c4b86d643e18e7deb04957a042d51d667eafa WatchSource:0}: Error finding container 591c0bb6fbea77bec6a848933d5c4b86d643e18e7deb04957a042d51d667eafa: Status 404 returned error can't find the container with id 591c0bb6fbea77bec6a848933d5c4b86d643e18e7deb04957a042d51d667eafa
Sep 06 10:37:44.593532 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:44.593495    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f3881d63-6xkhn" event={"ID":"96d83cab-d8cb-4ad7-9b45-7322e99ca260","Type":"ContainerStarted","Data":"ed5da1f7023f9df07ce1346104d4810fb91ecc1e8d6b3e53c38f926d9096e77b"}
Sep 06 10:37:44.593929 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:44.593553    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f3881d63-6xkhn" event={"ID":"96d83cab-d8cb-4ad7-9b45-7322e99ca260","Type":"ContainerStarted","Data":"591c0bb6fbea77bec6a848933d5c4b86d643e18e7deb04957a042d51d667eafa"}
Sep 06 10:37:44.608038 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:44.607989    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f3881d63-6xkhn" podStartSLOduration=1.607975627 podStartE2EDuration="1.607975627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:37:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:37:44.607861058 +0000 UTC m=+956.386280474" watchObservedRunningTime="2026-09-06 10:37:44.607975627 +0000 UTC m=+956.386395039"
Sep 06 10:37:44.920625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:44.920587    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:45.036102 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:45.036067    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:45.246650 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:45.246615    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:45.364248 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:45.364212    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:45.601345 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:45.601244    2561 generic.go:356] "Generic (PLEG): container finished" podID="96d83cab-d8cb-4ad7-9b45-7322e99ca260" containerID="ed5da1f7023f9df07ce1346104d4810fb91ecc1e8d6b3e53c38f926d9096e77b" exitCode=0
Sep 06 10:37:45.601715 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:45.601342    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f3881d63-6xkhn" event={"ID":"96d83cab-d8cb-4ad7-9b45-7322e99ca260","Type":"ContainerDied","Data":"ed5da1f7023f9df07ce1346104d4810fb91ecc1e8d6b3e53c38f926d9096e77b"}
Sep 06 10:37:45.997779 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:45.997751    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:46.102879 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:46.102841    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04526a-7mhsc"]
Sep 06 10:37:46.106512 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:46.106483    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04526a-7mhsc"
Sep 06 10:37:46.114088 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:46.114059    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04526a-7mhsc"]
Sep 06 10:37:46.186349 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:46.186281    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aded768-eb02-4b41-8373-2acaaa78c50f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-04526a-7mhsc\" (UID: \"0aded768-eb02-4b41-8373-2acaaa78c50f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04526a-7mhsc"
Sep 06 10:37:46.211336 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:46.211297    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:46.287648 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:46.287539    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aded768-eb02-4b41-8373-2acaaa78c50f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-04526a-7mhsc\" (UID: \"0aded768-eb02-4b41-8373-2acaaa78c50f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04526a-7mhsc"
Sep 06 10:37:46.288237 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:46.288216    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aded768-eb02-4b41-8373-2acaaa78c50f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-04526a-7mhsc\" (UID: \"0aded768-eb02-4b41-8373-2acaaa78c50f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04526a-7mhsc"
Sep 06 10:37:46.419830 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:46.419791    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04526a-7mhsc"
Sep 06 10:37:46.694656 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:37:46.694624    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aded768_eb02_4b41_8373_2acaaa78c50f.slice/crio-1322c607b6f5799b0ed55c16138b046f532888b539cbf5a8137a1ed25fc786a8 WatchSource:0}: Error finding container 1322c607b6f5799b0ed55c16138b046f532888b539cbf5a8137a1ed25fc786a8: Status 404 returned error can't find the container with id 1322c607b6f5799b0ed55c16138b046f532888b539cbf5a8137a1ed25fc786a8
Sep 06 10:37:46.695027 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:46.694943    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04526a-7mhsc"]
Sep 06 10:37:46.809280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:46.809255    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f3881d63-6xkhn"
Sep 06 10:37:46.893998 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:46.893907    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/96d83cab-d8cb-4ad7-9b45-7322e99ca260-maas-api-service-ca\") pod \"96d83cab-d8cb-4ad7-9b45-7322e99ca260\" (UID: \"96d83cab-d8cb-4ad7-9b45-7322e99ca260\") "
Sep 06 10:37:46.894297 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:46.894273    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96d83cab-d8cb-4ad7-9b45-7322e99ca260-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "96d83cab-d8cb-4ad7-9b45-7322e99ca260" (UID: "96d83cab-d8cb-4ad7-9b45-7322e99ca260"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:37:46.995703 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:46.995667    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/96d83cab-d8cb-4ad7-9b45-7322e99ca260-maas-api-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:37:47.615384 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:47.615348    2561 generic.go:356] "Generic (PLEG): container finished" podID="0aded768-eb02-4b41-8373-2acaaa78c50f" containerID="afffcf02e45148d35521a678c0c430eaa4266546c9f80401856e2627ba64ca73" exitCode=0
Sep 06 10:37:47.615546 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:47.615401    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04526a-7mhsc" event={"ID":"0aded768-eb02-4b41-8373-2acaaa78c50f","Type":"ContainerDied","Data":"afffcf02e45148d35521a678c0c430eaa4266546c9f80401856e2627ba64ca73"}
Sep 06 10:37:47.615546 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:47.615457    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04526a-7mhsc" event={"ID":"0aded768-eb02-4b41-8373-2acaaa78c50f","Type":"ContainerStarted","Data":"1322c607b6f5799b0ed55c16138b046f532888b539cbf5a8137a1ed25fc786a8"}
Sep 06 10:37:47.616740 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:47.616725    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f3881d63-6xkhn"
Sep 06 10:37:47.616828 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:47.616721    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f3881d63-6xkhn" event={"ID":"96d83cab-d8cb-4ad7-9b45-7322e99ca260","Type":"ContainerDied","Data":"591c0bb6fbea77bec6a848933d5c4b86d643e18e7deb04957a042d51d667eafa"}
Sep 06 10:37:47.616868 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:47.616853    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="591c0bb6fbea77bec6a848933d5c4b86d643e18e7deb04957a042d51d667eafa"
Sep 06 10:37:48.781097 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:48.781067    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04526a-7mhsc"
Sep 06 10:37:48.813501 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:48.813475    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aded768-eb02-4b41-8373-2acaaa78c50f-maas-api-service-ca\") pod \"0aded768-eb02-4b41-8373-2acaaa78c50f\" (UID: \"0aded768-eb02-4b41-8373-2acaaa78c50f\") "
Sep 06 10:37:48.813895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:48.813866    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aded768-eb02-4b41-8373-2acaaa78c50f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0aded768-eb02-4b41-8373-2acaaa78c50f" (UID: "0aded768-eb02-4b41-8373-2acaaa78c50f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:37:48.915078 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:48.915053    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aded768-eb02-4b41-8373-2acaaa78c50f-maas-api-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:37:49.630841 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:49.630816    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04526a-7mhsc"
Sep 06 10:37:49.631009 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:49.630841    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04526a-7mhsc" event={"ID":"0aded768-eb02-4b41-8373-2acaaa78c50f","Type":"ContainerDied","Data":"1322c607b6f5799b0ed55c16138b046f532888b539cbf5a8137a1ed25fc786a8"}
Sep 06 10:37:49.631009 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:49.630891    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1322c607b6f5799b0ed55c16138b046f532888b539cbf5a8137a1ed25fc786a8"
Sep 06 10:37:50.447918 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:50.447885    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:53.691897 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:53.691845    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:54.456394 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:54.456347    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f3881d63-6xkhn"]
Sep 06 10:37:54.458931 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:54.458908    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-f3881d63-6xkhn"]
Sep 06 10:37:54.755362 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:54.755250    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96d83cab-d8cb-4ad7-9b45-7322e99ca260" path="/var/lib/kubelet/pods/96d83cab-d8cb-4ad7-9b45-7322e99ca260/volumes"
Sep 06 10:37:54.902994 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:54.902959    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:55.792066 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:55.792018    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:55.892616 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:55.892583    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:56.299485 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:56.299445    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:56.883711 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:56.883683    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:56.957402 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:56.957302    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:57.024660 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:57.024624    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:57.094504 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:57.094467    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04526a-7mhsc"]
Sep 06 10:37:57.096201 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:57.096178    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:57.097354 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:57.097335    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-04526a-7mhsc"]
Sep 06 10:37:57.160039 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:57.160013    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:57.469972 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:57.469899    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:37:58.762658 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:37:58.762626    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aded768-eb02-4b41-8373-2acaaa78c50f" path="/var/lib/kubelet/pods/0aded768-eb02-4b41-8373-2acaaa78c50f/volumes"
Sep 06 10:38:00.643220 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:00.643187    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:00.744823 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:00.744796    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:00.805061 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:00.805025    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"]
Sep 06 10:38:00.805305 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:00.805279    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7" podUID="b2301b15-52d3-4529-ab00-955235f8fe12" containerName="istio-proxy" containerID="cri-o://06494df996b6cdbd7990e00bb1d401c47278142c9564de29c293cce584f65f53" gracePeriod=30
Sep 06 10:38:00.828173 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:00.828145    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:01.236539 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:01.236507    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:01.336624 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:01.336592    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:01.436032 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:01.436004    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:02.342676 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:02.342647    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:02.443346 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:02.443293    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:03.392420 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:03.392380    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:03.453425 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:03.453393    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:03.628154 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:03.628124    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"]
Sep 06 10:38:03.628394 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:03.628373    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55" podUID="6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" containerName="istio-proxy" containerID="cri-o://5974e6e3c4499bc15a93590cbb9d3d56e091ff90b63e5100b8f224e1dc92876e" gracePeriod=30
Sep 06 10:38:03.646575 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:03.646505    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:03.981260 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:03.981225    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bd3407-6wf4z"]
Sep 06 10:38:03.981684 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:03.981670    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96d83cab-d8cb-4ad7-9b45-7322e99ca260" containerName="revoke-keys"
Sep 06 10:38:03.981734 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:03.981686    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="96d83cab-d8cb-4ad7-9b45-7322e99ca260" containerName="revoke-keys"
Sep 06 10:38:03.981734 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:03.981704    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aded768-eb02-4b41-8373-2acaaa78c50f" containerName="revoke-keys"
Sep 06 10:38:03.981734 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:03.981709    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aded768-eb02-4b41-8373-2acaaa78c50f" containerName="revoke-keys"
Sep 06 10:38:03.981845 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:03.981785    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aded768-eb02-4b41-8373-2acaaa78c50f" containerName="revoke-keys"
Sep 06 10:38:03.981845 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:03.981793    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="96d83cab-d8cb-4ad7-9b45-7322e99ca260" containerName="revoke-keys"
Sep 06 10:38:03.985953 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:03.985936    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bd3407-6wf4z"
Sep 06 10:38:03.988259 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:03.988228    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n5b2f\""
Sep 06 10:38:03.991090 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:03.991069    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bd3407-6wf4z"]
Sep 06 10:38:04.067577 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:04.067545    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/646a54e5-be65-458c-91f3-428122710941-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-bd3407-6wf4z\" (UID: \"646a54e5-be65-458c-91f3-428122710941\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bd3407-6wf4z"
Sep 06 10:38:04.126872 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:04.126842    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:04.168946 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:04.168913    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/646a54e5-be65-458c-91f3-428122710941-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-bd3407-6wf4z\" (UID: \"646a54e5-be65-458c-91f3-428122710941\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bd3407-6wf4z"
Sep 06 10:38:04.169733 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:04.169705    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/646a54e5-be65-458c-91f3-428122710941-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-bd3407-6wf4z\" (UID: \"646a54e5-be65-458c-91f3-428122710941\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bd3407-6wf4z"
Sep 06 10:38:04.298056 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:04.297975    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bd3407-6wf4z"
Sep 06 10:38:04.565836 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:04.565802    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bd3407-6wf4z"]
Sep 06 10:38:04.567007 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:38:04.566982    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod646a54e5_be65_458c_91f3_428122710941.slice/crio-95c90b800ec73e015dcc8b45e4c22051ca6e6be4369576d3d7f0d0010085c208 WatchSource:0}: Error finding container 95c90b800ec73e015dcc8b45e4c22051ca6e6be4369576d3d7f0d0010085c208: Status 404 returned error can't find the container with id 95c90b800ec73e015dcc8b45e4c22051ca6e6be4369576d3d7f0d0010085c208
Sep 06 10:38:04.722975 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:04.722944    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bd3407-6wf4z" event={"ID":"646a54e5-be65-458c-91f3-428122710941","Type":"ContainerStarted","Data":"95c90b800ec73e015dcc8b45e4c22051ca6e6be4369576d3d7f0d0010085c208"}
Sep 06 10:38:05.730547 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:05.730513    2561 generic.go:356] "Generic (PLEG): container finished" podID="646a54e5-be65-458c-91f3-428122710941" containerID="d1ac5881f26a3584aceed7e91cdd92729849ab4e84b70d614548d71fff1c854b" exitCode=0
Sep 06 10:38:05.730936 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:05.730600    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bd3407-6wf4z" event={"ID":"646a54e5-be65-458c-91f3-428122710941","Type":"ContainerDied","Data":"d1ac5881f26a3584aceed7e91cdd92729849ab4e84b70d614548d71fff1c854b"}
Sep 06 10:38:06.079468 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.079443    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:38:06.190368 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.190307    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-istio-data\") pod \"b2301b15-52d3-4529-ab00-955235f8fe12\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") "
Sep 06 10:38:06.190368 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.190377    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2301b15-52d3-4529-ab00-955235f8fe12-istio-podinfo\") pod \"b2301b15-52d3-4529-ab00-955235f8fe12\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") "
Sep 06 10:38:06.190585 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.190427    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-workload-socket\") pod \"b2301b15-52d3-4529-ab00-955235f8fe12\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") "
Sep 06 10:38:06.190585 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.190465    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-istio-envoy\") pod \"b2301b15-52d3-4529-ab00-955235f8fe12\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") "
Sep 06 10:38:06.190585 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.190489    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-credential-socket\") pod \"b2301b15-52d3-4529-ab00-955235f8fe12\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") "
Sep 06 10:38:06.190585 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.190517    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2301b15-52d3-4529-ab00-955235f8fe12-istiod-ca-cert\") pod \"b2301b15-52d3-4529-ab00-955235f8fe12\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") "
Sep 06 10:38:06.190585 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.190548    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2301b15-52d3-4529-ab00-955235f8fe12-istio-token\") pod \"b2301b15-52d3-4529-ab00-955235f8fe12\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") "
Sep 06 10:38:06.190585 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.190578    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdlfz\" (UniqueName: \"kubernetes.io/projected/b2301b15-52d3-4529-ab00-955235f8fe12-kube-api-access-xdlfz\") pod \"b2301b15-52d3-4529-ab00-955235f8fe12\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") "
Sep 06 10:38:06.190907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.190622    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-workload-certs\") pod \"b2301b15-52d3-4529-ab00-955235f8fe12\" (UID: \"b2301b15-52d3-4529-ab00-955235f8fe12\") "
Sep 06 10:38:06.190907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.190622    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-istio-data" (OuterVolumeSpecName: "istio-data") pod "b2301b15-52d3-4529-ab00-955235f8fe12" (UID: "b2301b15-52d3-4529-ab00-955235f8fe12"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:38:06.190907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.190799    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b2301b15-52d3-4529-ab00-955235f8fe12" (UID: "b2301b15-52d3-4529-ab00-955235f8fe12"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:38:06.190907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.190815    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b2301b15-52d3-4529-ab00-955235f8fe12" (UID: "b2301b15-52d3-4529-ab00-955235f8fe12"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:38:06.191103 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.190988    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b2301b15-52d3-4529-ab00-955235f8fe12" (UID: "b2301b15-52d3-4529-ab00-955235f8fe12"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:38:06.191103 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.191011    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:06.191103 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.191034    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:06.191103 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.191051    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:06.191103 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.191054    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2301b15-52d3-4529-ab00-955235f8fe12-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b2301b15-52d3-4529-ab00-955235f8fe12" (UID: "b2301b15-52d3-4529-ab00-955235f8fe12"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:38:06.193273 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.193240    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b2301b15-52d3-4529-ab00-955235f8fe12" (UID: "b2301b15-52d3-4529-ab00-955235f8fe12"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:38:06.193425 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.193302    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b2301b15-52d3-4529-ab00-955235f8fe12-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b2301b15-52d3-4529-ab00-955235f8fe12" (UID: "b2301b15-52d3-4529-ab00-955235f8fe12"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 10:38:06.193425 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.193315    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2301b15-52d3-4529-ab00-955235f8fe12-kube-api-access-xdlfz" (OuterVolumeSpecName: "kube-api-access-xdlfz") pod "b2301b15-52d3-4529-ab00-955235f8fe12" (UID: "b2301b15-52d3-4529-ab00-955235f8fe12"). InnerVolumeSpecName "kube-api-access-xdlfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:38:06.193425 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.193360    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2301b15-52d3-4529-ab00-955235f8fe12-istio-token" (OuterVolumeSpecName: "istio-token") pod "b2301b15-52d3-4529-ab00-955235f8fe12" (UID: "b2301b15-52d3-4529-ab00-955235f8fe12"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:38:06.291909 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.291881    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:06.291909 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.291904    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2301b15-52d3-4529-ab00-955235f8fe12-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:06.291909 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.291912    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2301b15-52d3-4529-ab00-955235f8fe12-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:06.292125 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.291920    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdlfz\" (UniqueName: \"kubernetes.io/projected/b2301b15-52d3-4529-ab00-955235f8fe12-kube-api-access-xdlfz\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:06.292125 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.291928    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2301b15-52d3-4529-ab00-955235f8fe12-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:06.292125 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.291938    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2301b15-52d3-4529-ab00-955235f8fe12-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:06.741550 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.741510    2561 generic.go:356] "Generic (PLEG): container finished" podID="b2301b15-52d3-4529-ab00-955235f8fe12" containerID="06494df996b6cdbd7990e00bb1d401c47278142c9564de29c293cce584f65f53" exitCode=0
Sep 06 10:38:06.742027 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.741570    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"
Sep 06 10:38:06.742027 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.741612    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7" event={"ID":"b2301b15-52d3-4529-ab00-955235f8fe12","Type":"ContainerDied","Data":"06494df996b6cdbd7990e00bb1d401c47278142c9564de29c293cce584f65f53"}
Sep 06 10:38:06.742027 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.741673    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7" event={"ID":"b2301b15-52d3-4529-ab00-955235f8fe12","Type":"ContainerDied","Data":"5851684f2f9c51586e7e4f071abd116535ca8c4e63ea23b50512789d37f57ca7"}
Sep 06 10:38:06.742027 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.741700    2561 scope.go:117] "RemoveContainer" containerID="06494df996b6cdbd7990e00bb1d401c47278142c9564de29c293cce584f65f53"
Sep 06 10:38:06.753070 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.753046    2561 scope.go:117] "RemoveContainer" containerID="7b1215caab66be9785640f4fc4e2b8a76694807b876069c190a5628222b8a293"
Sep 06 10:38:06.762904 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.762878    2561 scope.go:117] "RemoveContainer" containerID="06494df996b6cdbd7990e00bb1d401c47278142c9564de29c293cce584f65f53"
Sep 06 10:38:06.763367 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:38:06.763316    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06494df996b6cdbd7990e00bb1d401c47278142c9564de29c293cce584f65f53\": container with ID starting with 06494df996b6cdbd7990e00bb1d401c47278142c9564de29c293cce584f65f53 not found: ID does not exist" containerID="06494df996b6cdbd7990e00bb1d401c47278142c9564de29c293cce584f65f53"
Sep 06 10:38:06.763643 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.763587    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06494df996b6cdbd7990e00bb1d401c47278142c9564de29c293cce584f65f53"} err="failed to get container status \"06494df996b6cdbd7990e00bb1d401c47278142c9564de29c293cce584f65f53\": rpc error: code = NotFound desc = could not find container \"06494df996b6cdbd7990e00bb1d401c47278142c9564de29c293cce584f65f53\": container with ID starting with 06494df996b6cdbd7990e00bb1d401c47278142c9564de29c293cce584f65f53 not found: ID does not exist"
Sep 06 10:38:06.763807 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.763785    2561 scope.go:117] "RemoveContainer" containerID="7b1215caab66be9785640f4fc4e2b8a76694807b876069c190a5628222b8a293"
Sep 06 10:38:06.764133 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:38:06.764104    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b1215caab66be9785640f4fc4e2b8a76694807b876069c190a5628222b8a293\": container with ID starting with 7b1215caab66be9785640f4fc4e2b8a76694807b876069c190a5628222b8a293 not found: ID does not exist" containerID="7b1215caab66be9785640f4fc4e2b8a76694807b876069c190a5628222b8a293"
Sep 06 10:38:06.764240 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.764130    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b1215caab66be9785640f4fc4e2b8a76694807b876069c190a5628222b8a293"} err="failed to get container status \"7b1215caab66be9785640f4fc4e2b8a76694807b876069c190a5628222b8a293\": rpc error: code = NotFound desc = could not find container \"7b1215caab66be9785640f4fc4e2b8a76694807b876069c190a5628222b8a293\": container with ID starting with 7b1215caab66be9785640f4fc4e2b8a76694807b876069c190a5628222b8a293 not found: ID does not exist"
Sep 06 10:38:06.767204 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.767182    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"]
Sep 06 10:38:06.770490 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.770467    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f3881d63-openshift-default-6b87898cfb-rpqb7"]
Sep 06 10:38:06.880869 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.880843    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bd3407-6wf4z"
Sep 06 10:38:06.997696 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.997612    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/646a54e5-be65-458c-91f3-428122710941-maas-api-service-ca\") pod \"646a54e5-be65-458c-91f3-428122710941\" (UID: \"646a54e5-be65-458c-91f3-428122710941\") "
Sep 06 10:38:06.997959 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:06.997937    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/646a54e5-be65-458c-91f3-428122710941-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "646a54e5-be65-458c-91f3-428122710941" (UID: "646a54e5-be65-458c-91f3-428122710941"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:38:07.098679 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:07.098637    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/646a54e5-be65-458c-91f3-428122710941-maas-api-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:07.183847 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:07.183816    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:07.249785 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:07.249705    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:07.326239 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:07.326205    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:07.428081 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:07.428045    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:07.527420 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:07.527337    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:07.756881 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:07.756848    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bd3407-6wf4z"
Sep 06 10:38:07.757361 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:07.756880    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bd3407-6wf4z" event={"ID":"646a54e5-be65-458c-91f3-428122710941","Type":"ContainerDied","Data":"95c90b800ec73e015dcc8b45e4c22051ca6e6be4369576d3d7f0d0010085c208"}
Sep 06 10:38:07.757361 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:07.756965    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95c90b800ec73e015dcc8b45e4c22051ca6e6be4369576d3d7f0d0010085c208"
Sep 06 10:38:08.755193 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:08.755163    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2301b15-52d3-4529-ab00-955235f8fe12" path="/var/lib/kubelet/pods/b2301b15-52d3-4529-ab00-955235f8fe12/volumes"
Sep 06 10:38:08.766492 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:08.766463    2561 generic.go:356] "Generic (PLEG): container finished" podID="6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" containerID="5974e6e3c4499bc15a93590cbb9d3d56e091ff90b63e5100b8f224e1dc92876e" exitCode=0
Sep 06 10:38:08.766986 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:08.766540    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55" event={"ID":"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9","Type":"ContainerDied","Data":"5974e6e3c4499bc15a93590cbb9d3d56e091ff90b63e5100b8f224e1dc92876e"}
Sep 06 10:38:08.766986 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:08.766614    2561 scope.go:117] "RemoveContainer" containerID="834e1cc4fb154e8bade93b9a02d17113372ed8a89d4d481261f085474597663e"
Sep 06 10:38:08.881037 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:08.881011    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:38:09.020613 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.020578    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-envoy\") pod \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") "
Sep 06 10:38:09.020817 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.020621    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-token\") pod \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") "
Sep 06 10:38:09.020817 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.020688    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-workload-socket\") pod \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") "
Sep 06 10:38:09.020817 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.020742    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cws4v\" (UniqueName: \"kubernetes.io/projected/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-kube-api-access-cws4v\") pod \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") "
Sep 06 10:38:09.020817 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.020773    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-data\") pod \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") "
Sep 06 10:38:09.021036 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.020833    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-workload-certs\") pod \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") "
Sep 06 10:38:09.021036 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.020858    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-podinfo\") pod \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") "
Sep 06 10:38:09.021036 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.020913    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istiod-ca-cert\") pod \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") "
Sep 06 10:38:09.021036 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.020924    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" (UID: "6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:38:09.021036 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.020942    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-credential-socket\") pod \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\" (UID: \"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9\") "
Sep 06 10:38:09.021293 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.021120    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-data" (OuterVolumeSpecName: "istio-data") pod "6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" (UID: "6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:38:09.021293 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.021146    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" (UID: "6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:38:09.021452 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.021376    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" (UID: "6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:38:09.021534 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.021509    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:09.021600 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.021536    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:09.021600 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.021551    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:09.021600 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.021566    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:09.021790 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.021628    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" (UID: "6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:38:09.023858 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.023829    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-token" (OuterVolumeSpecName: "istio-token") pod "6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" (UID: "6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:38:09.023983 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.023883    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" (UID: "6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:38:09.024206 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.024181    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-kube-api-access-cws4v" (OuterVolumeSpecName: "kube-api-access-cws4v") pod "6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" (UID: "6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9"). InnerVolumeSpecName "kube-api-access-cws4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:38:09.024290 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.024263    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" (UID: "6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 10:38:09.123026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.122991    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cws4v\" (UniqueName: \"kubernetes.io/projected/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-kube-api-access-cws4v\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:09.123026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.123020    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:09.123026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.123031    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:09.123258 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.123040    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:09.123258 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.123047    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:09.774474 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.774448    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"
Sep 06 10:38:09.774920 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.774482    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55" event={"ID":"6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9","Type":"ContainerDied","Data":"37e0700950670d8972079c5377f651da6c51bd6ae2b63fbcb03339e0f69b3e4f"}
Sep 06 10:38:09.774920 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.774532    2561 scope.go:117] "RemoveContainer" containerID="5974e6e3c4499bc15a93590cbb9d3d56e091ff90b63e5100b8f224e1dc92876e"
Sep 06 10:38:09.796545 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.796514    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"]
Sep 06 10:38:09.799053 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:09.799034    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-04526a-openshift-default-76b687fd-lld55"]
Sep 06 10:38:10.755491 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:10.755449    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" path="/var/lib/kubelet/pods/6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9/volumes"
Sep 06 10:38:13.331649 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:13.331614    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:13.395985 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:13.395956    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:14.213686 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:14.213656    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:14.498103 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:14.498021    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:14.556374 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:14.556313    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4"]
Sep 06 10:38:14.556601 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:14.556573    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4" podUID="89ec3933-7417-4bc5-88fa-82273c8f5c82" containerName="payload-processing" containerID="cri-o://cc85a7131e36e6c450dd9c708cf0a66d5572da06ddad58b5e9bac9a18e7bad2e" gracePeriod=30
Sep 06 10:38:14.587782 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:14.587744    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:14.651300 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:14.651274    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:14.726831 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:14.726731    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:14.728264 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:14.728235    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bd3407-6wf4z"]
Sep 06 10:38:14.731438 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:14.731412    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-bd3407-6wf4z"]
Sep 06 10:38:14.757379 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:14.757298    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="646a54e5-be65-458c-91f3-428122710941" path="/var/lib/kubelet/pods/646a54e5-be65-458c-91f3-428122710941/volumes"
Sep 06 10:38:14.785520 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:14.785495    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:14.807776 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:14.807743    2561 generic.go:356] "Generic (PLEG): container finished" podID="89ec3933-7417-4bc5-88fa-82273c8f5c82" containerID="cc85a7131e36e6c450dd9c708cf0a66d5572da06ddad58b5e9bac9a18e7bad2e" exitCode=0
Sep 06 10:38:14.807832 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:14.807780    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4" event={"ID":"89ec3933-7417-4bc5-88fa-82273c8f5c82","Type":"ContainerDied","Data":"cc85a7131e36e6c450dd9c708cf0a66d5572da06ddad58b5e9bac9a18e7bad2e"}
Sep 06 10:38:14.823804 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:14.823782    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4"
Sep 06 10:38:14.876160 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:14.876129    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm9xj\" (UniqueName: \"kubernetes.io/projected/89ec3933-7417-4bc5-88fa-82273c8f5c82-kube-api-access-gm9xj\") pod \"89ec3933-7417-4bc5-88fa-82273c8f5c82\" (UID: \"89ec3933-7417-4bc5-88fa-82273c8f5c82\") "
Sep 06 10:38:14.876376 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:14.876228    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89ec3933-7417-4bc5-88fa-82273c8f5c82-plugins-config-volume\") pod \"89ec3933-7417-4bc5-88fa-82273c8f5c82\" (UID: \"89ec3933-7417-4bc5-88fa-82273c8f5c82\") "
Sep 06 10:38:14.876637 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:14.876615    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89ec3933-7417-4bc5-88fa-82273c8f5c82-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "89ec3933-7417-4bc5-88fa-82273c8f5c82" (UID: "89ec3933-7417-4bc5-88fa-82273c8f5c82"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:38:14.878315 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:14.878291    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89ec3933-7417-4bc5-88fa-82273c8f5c82-kube-api-access-gm9xj" (OuterVolumeSpecName: "kube-api-access-gm9xj") pod "89ec3933-7417-4bc5-88fa-82273c8f5c82" (UID: "89ec3933-7417-4bc5-88fa-82273c8f5c82"). InnerVolumeSpecName "kube-api-access-gm9xj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:38:14.977820 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:14.977778    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/89ec3933-7417-4bc5-88fa-82273c8f5c82-plugins-config-volume\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:14.977820 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:14.977815    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm9xj\" (UniqueName: \"kubernetes.io/projected/89ec3933-7417-4bc5-88fa-82273c8f5c82-kube-api-access-gm9xj\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:15.080140 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:15.080055    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:15.814943 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:15.814919    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4"
Sep 06 10:38:15.815408 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:15.814961    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4" event={"ID":"89ec3933-7417-4bc5-88fa-82273c8f5c82","Type":"ContainerDied","Data":"85b1c57d3c2ff14795d3f7b23b76d38a5f0863531549fe5c8fc8d2b05ad95fa2"}
Sep 06 10:38:15.815408 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:15.815019    2561 scope.go:117] "RemoveContainer" containerID="cc85a7131e36e6c450dd9c708cf0a66d5572da06ddad58b5e9bac9a18e7bad2e"
Sep 06 10:38:15.838059 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:15.838032    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4"]
Sep 06 10:38:15.840619 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:15.840594    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-bd3407-78bfdb87d7-9smf4"]
Sep 06 10:38:16.754912 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:16.754878    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89ec3933-7417-4bc5-88fa-82273c8f5c82" path="/var/lib/kubelet/pods/89ec3933-7417-4bc5-88fa-82273c8f5c82/volumes"
Sep 06 10:38:17.941109 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:17.941066    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:18.030703 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:18.030647    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:19.323513 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:19.323483    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:19.389188 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:19.389161    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:19.689340 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:19.689300    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:19.800708 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:19.800678    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:19.900753 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:19.900715    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:21.225906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:21.225870    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:21.292540 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:21.292506    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:21.472809 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:21.472774    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"]
Sep 06 10:38:21.473004 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:21.472981    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm" podUID="160689e4-3c5a-4be0-a457-de7df77fccb5" containerName="istio-proxy" containerID="cri-o://19dc179aed4657252bafc27fa4f2d2089bcc020ca3352e6ed895d401b38314cb" gracePeriod=30
Sep 06 10:38:21.488955 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:21.488879    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:22.039707 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.039670    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:22.308570 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.308492    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"]
Sep 06 10:38:22.309073 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.309049    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" containerName="istio-proxy"
Sep 06 10:38:22.309167 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.309074    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" containerName="istio-proxy"
Sep 06 10:38:22.309167 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.309088    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2301b15-52d3-4529-ab00-955235f8fe12" containerName="istio-proxy"
Sep 06 10:38:22.309167 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.309096    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2301b15-52d3-4529-ab00-955235f8fe12" containerName="istio-proxy"
Sep 06 10:38:22.309167 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.309105    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="646a54e5-be65-458c-91f3-428122710941" containerName="revoke-keys"
Sep 06 10:38:22.309167 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.309113    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="646a54e5-be65-458c-91f3-428122710941" containerName="revoke-keys"
Sep 06 10:38:22.309167 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.309123    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2301b15-52d3-4529-ab00-955235f8fe12" containerName="istio-proxy"
Sep 06 10:38:22.309167 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.309131    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2301b15-52d3-4529-ab00-955235f8fe12" containerName="istio-proxy"
Sep 06 10:38:22.309167 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.309144    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" containerName="istio-proxy"
Sep 06 10:38:22.309167 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.309152    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" containerName="istio-proxy"
Sep 06 10:38:22.309640 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.309181    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89ec3933-7417-4bc5-88fa-82273c8f5c82" containerName="payload-processing"
Sep 06 10:38:22.309640 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.309191    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="89ec3933-7417-4bc5-88fa-82273c8f5c82" containerName="payload-processing"
Sep 06 10:38:22.309640 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.309317    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" containerName="istio-proxy"
Sep 06 10:38:22.309640 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.309345    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2301b15-52d3-4529-ab00-955235f8fe12" containerName="istio-proxy"
Sep 06 10:38:22.309640 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.309358    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="89ec3933-7417-4bc5-88fa-82273c8f5c82" containerName="payload-processing"
Sep 06 10:38:22.309640 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.309365    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="646a54e5-be65-458c-91f3-428122710941" containerName="revoke-keys"
Sep 06 10:38:22.312967 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.312945    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.315372 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.315351    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-6751d7-openshift-default-dockercfg-r472f\""
Sep 06 10:38:22.327226 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.326697    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"]
Sep 06 10:38:22.337523 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.337495    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:22.344506 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.344478    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-workload-socket\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.344637 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.344552    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-workload-certs\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.344637 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.344575    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-data\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.344637 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.344620    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istiod-ca-cert\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.344763 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.344683    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-credential-socket\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.344763 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.344747    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-token\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.344844 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.344776    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8fx7\" (UniqueName: \"kubernetes.io/projected/eafa52ae-6ca8-4303-911d-9b15f11b78f4-kube-api-access-n8fx7\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.344844 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.344824    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-envoy\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.344923 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.344846    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-podinfo\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.445948 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.445914    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-workload-certs\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.445948 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.445950    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-data\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.446212 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.445982    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istiod-ca-cert\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.446212 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.446015    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-credential-socket\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.446212 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.446056    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-token\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.446212 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.446088    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8fx7\" (UniqueName: \"kubernetes.io/projected/eafa52ae-6ca8-4303-911d-9b15f11b78f4-kube-api-access-n8fx7\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.446212 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.446120    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-envoy\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.446212 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.446143    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-podinfo\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.446212 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.446170    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-workload-socket\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.446635 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.446380    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-workload-certs\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.446635 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.446505    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-data\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.446751 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.446672    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-credential-socket\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.446751 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.446704    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-workload-socket\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.446852 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.446776    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istiod-ca-cert\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.448407 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.448385    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-envoy\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.448797 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.448775    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-podinfo\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.453492 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.453471    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-token\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.453622 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.453605    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8fx7\" (UniqueName: \"kubernetes.io/projected/eafa52ae-6ca8-4303-911d-9b15f11b78f4-kube-api-access-n8fx7\") pod \"e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") " pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.501315 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.501288    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:22.625558 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.625476    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:22.902746 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.902719    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"]
Sep 06 10:38:22.904349 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:38:22.904300    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeafa52ae_6ca8_4303_911d_9b15f11b78f4.slice/crio-356179d23c6da295118add53df5e0040975b40e12b1cb813b0631551e007ddfc WatchSource:0}: Error finding container 356179d23c6da295118add53df5e0040975b40e12b1cb813b0631551e007ddfc: Status 404 returned error can't find the container with id 356179d23c6da295118add53df5e0040975b40e12b1cb813b0631551e007ddfc
Sep 06 10:38:22.906595 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.906567    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:38:22.906673 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.906629    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:38:22.906673 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:22.906658    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:38:23.865556 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:23.865516    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn" event={"ID":"eafa52ae-6ca8-4303-911d-9b15f11b78f4","Type":"ContainerStarted","Data":"4a5aab000926dc4dafabd88c3ce94c1ec59203e1260cf55839d08b9e54622527"}
Sep 06 10:38:23.865922 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:23.865566    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn" event={"ID":"eafa52ae-6ca8-4303-911d-9b15f11b78f4","Type":"ContainerStarted","Data":"356179d23c6da295118add53df5e0040975b40e12b1cb813b0631551e007ddfc"}
Sep 06 10:38:23.885697 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:23.885649    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn" podStartSLOduration=1.885635679 podStartE2EDuration="1.885635679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:38:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:38:23.883431298 +0000 UTC m=+995.661850711" watchObservedRunningTime="2026-09-06 10:38:23.885635679 +0000 UTC m=+995.664055092"
Sep 06 10:38:24.626394 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:24.626354    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:24.631331 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:24.631296    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:24.871039 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:24.871005    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:24.871873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:24.871854    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:25.859541 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:25.859502    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:25.959625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:25.959596    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:26.728433 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.728399    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:38:26.791478 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.791405    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-envoy\") pod \"160689e4-3c5a-4be0-a457-de7df77fccb5\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") "
Sep 06 10:38:26.791478 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.791468    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-podinfo\") pod \"160689e4-3c5a-4be0-a457-de7df77fccb5\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") "
Sep 06 10:38:26.791679 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.791499    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-workload-certs\") pod \"160689e4-3c5a-4be0-a457-de7df77fccb5\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") "
Sep 06 10:38:26.791679 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.791563    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-workload-socket\") pod \"160689e4-3c5a-4be0-a457-de7df77fccb5\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") "
Sep 06 10:38:26.791679 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.791588    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-credential-socket\") pod \"160689e4-3c5a-4be0-a457-de7df77fccb5\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") "
Sep 06 10:38:26.791845 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.791687    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-data\") pod \"160689e4-3c5a-4be0-a457-de7df77fccb5\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") "
Sep 06 10:38:26.791845 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.791753    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bcmg\" (UniqueName: \"kubernetes.io/projected/160689e4-3c5a-4be0-a457-de7df77fccb5-kube-api-access-4bcmg\") pod \"160689e4-3c5a-4be0-a457-de7df77fccb5\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") "
Sep 06 10:38:26.791845 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.791792    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-token\") pod \"160689e4-3c5a-4be0-a457-de7df77fccb5\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") "
Sep 06 10:38:26.791998 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.791847    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "160689e4-3c5a-4be0-a457-de7df77fccb5" (UID: "160689e4-3c5a-4be0-a457-de7df77fccb5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:38:26.791998 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.791868    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "160689e4-3c5a-4be0-a457-de7df77fccb5" (UID: "160689e4-3c5a-4be0-a457-de7df77fccb5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:38:26.791998 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.791949    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "160689e4-3c5a-4be0-a457-de7df77fccb5" (UID: "160689e4-3c5a-4be0-a457-de7df77fccb5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:38:26.792170 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.792153    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/160689e4-3c5a-4be0-a457-de7df77fccb5-istiod-ca-cert\") pod \"160689e4-3c5a-4be0-a457-de7df77fccb5\" (UID: \"160689e4-3c5a-4be0-a457-de7df77fccb5\") "
Sep 06 10:38:26.792376 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.792290    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-data" (OuterVolumeSpecName: "istio-data") pod "160689e4-3c5a-4be0-a457-de7df77fccb5" (UID: "160689e4-3c5a-4be0-a457-de7df77fccb5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:38:26.792376 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.792337    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/160689e4-3c5a-4be0-a457-de7df77fccb5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "160689e4-3c5a-4be0-a457-de7df77fccb5" (UID: "160689e4-3c5a-4be0-a457-de7df77fccb5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:38:26.792709 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.792685    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:26.792812 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.792714    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:26.792812 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.792730    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:26.792812 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.792745    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/160689e4-3c5a-4be0-a457-de7df77fccb5-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:26.792812 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.792759    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:26.793856 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.793835    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "160689e4-3c5a-4be0-a457-de7df77fccb5" (UID: "160689e4-3c5a-4be0-a457-de7df77fccb5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 10:38:26.794240 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.794217    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/160689e4-3c5a-4be0-a457-de7df77fccb5-kube-api-access-4bcmg" (OuterVolumeSpecName: "kube-api-access-4bcmg") pod "160689e4-3c5a-4be0-a457-de7df77fccb5" (UID: "160689e4-3c5a-4be0-a457-de7df77fccb5"). InnerVolumeSpecName "kube-api-access-4bcmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:38:26.794240 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.794227    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "160689e4-3c5a-4be0-a457-de7df77fccb5" (UID: "160689e4-3c5a-4be0-a457-de7df77fccb5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:38:26.794373 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.794237    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-token" (OuterVolumeSpecName: "istio-token") pod "160689e4-3c5a-4be0-a457-de7df77fccb5" (UID: "160689e4-3c5a-4be0-a457-de7df77fccb5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:38:26.885521 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.885484    2561 generic.go:356] "Generic (PLEG): container finished" podID="160689e4-3c5a-4be0-a457-de7df77fccb5" containerID="19dc179aed4657252bafc27fa4f2d2089bcc020ca3352e6ed895d401b38314cb" exitCode=0
Sep 06 10:38:26.885697 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.885528    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"
Sep 06 10:38:26.885697 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.885576    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm" event={"ID":"160689e4-3c5a-4be0-a457-de7df77fccb5","Type":"ContainerDied","Data":"19dc179aed4657252bafc27fa4f2d2089bcc020ca3352e6ed895d401b38314cb"}
Sep 06 10:38:26.885697 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.885639    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm" event={"ID":"160689e4-3c5a-4be0-a457-de7df77fccb5","Type":"ContainerDied","Data":"cabad36da7449401871b5132ff56d935fb416ef59de8462361d160ba8ed85b86"}
Sep 06 10:38:26.885697 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.885669    2561 scope.go:117] "RemoveContainer" containerID="19dc179aed4657252bafc27fa4f2d2089bcc020ca3352e6ed895d401b38314cb"
Sep 06 10:38:26.893735 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.893664    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:26.893735 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.893689    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bcmg\" (UniqueName: \"kubernetes.io/projected/160689e4-3c5a-4be0-a457-de7df77fccb5-kube-api-access-4bcmg\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:26.893735 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.893704    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:26.893735 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.893717    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/160689e4-3c5a-4be0-a457-de7df77fccb5-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:38:26.897823 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.897807    2561 scope.go:117] "RemoveContainer" containerID="bfbc005034174a355fd563096e79905cc8abf92b087657b8b052d9b2f327d487"
Sep 06 10:38:26.906172 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.906156    2561 scope.go:117] "RemoveContainer" containerID="19dc179aed4657252bafc27fa4f2d2089bcc020ca3352e6ed895d401b38314cb"
Sep 06 10:38:26.906450 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:38:26.906430    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19dc179aed4657252bafc27fa4f2d2089bcc020ca3352e6ed895d401b38314cb\": container with ID starting with 19dc179aed4657252bafc27fa4f2d2089bcc020ca3352e6ed895d401b38314cb not found: ID does not exist" containerID="19dc179aed4657252bafc27fa4f2d2089bcc020ca3352e6ed895d401b38314cb"
Sep 06 10:38:26.906502 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.906458    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19dc179aed4657252bafc27fa4f2d2089bcc020ca3352e6ed895d401b38314cb"} err="failed to get container status \"19dc179aed4657252bafc27fa4f2d2089bcc020ca3352e6ed895d401b38314cb\": rpc error: code = NotFound desc = could not find container \"19dc179aed4657252bafc27fa4f2d2089bcc020ca3352e6ed895d401b38314cb\": container with ID starting with 19dc179aed4657252bafc27fa4f2d2089bcc020ca3352e6ed895d401b38314cb not found: ID does not exist"
Sep 06 10:38:26.906502 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.906474    2561 scope.go:117] "RemoveContainer" containerID="bfbc005034174a355fd563096e79905cc8abf92b087657b8b052d9b2f327d487"
Sep 06 10:38:26.906725 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:38:26.906709    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfbc005034174a355fd563096e79905cc8abf92b087657b8b052d9b2f327d487\": container with ID starting with bfbc005034174a355fd563096e79905cc8abf92b087657b8b052d9b2f327d487 not found: ID does not exist" containerID="bfbc005034174a355fd563096e79905cc8abf92b087657b8b052d9b2f327d487"
Sep 06 10:38:26.906775 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.906734    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfbc005034174a355fd563096e79905cc8abf92b087657b8b052d9b2f327d487"} err="failed to get container status \"bfbc005034174a355fd563096e79905cc8abf92b087657b8b052d9b2f327d487\": rpc error: code = NotFound desc = could not find container \"bfbc005034174a355fd563096e79905cc8abf92b087657b8b052d9b2f327d487\": container with ID starting with bfbc005034174a355fd563096e79905cc8abf92b087657b8b052d9b2f327d487 not found: ID does not exist"
Sep 06 10:38:26.912475 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.912456    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"]
Sep 06 10:38:26.916516 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:26.916495    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-bd3407-openshift-default-7ff858bb64-ctwkm"]
Sep 06 10:38:27.112564 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:27.112489    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:27.177498 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:27.177460    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:27.274849 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:27.274816    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:27.585143 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:27.585113    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:27.688542 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:27.688510    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:28.754905 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:28.754875    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="160689e4-3c5a-4be0-a457-de7df77fccb5" path="/var/lib/kubelet/pods/160689e4-3c5a-4be0-a457-de7df77fccb5/volumes"
Sep 06 10:38:40.311781 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:40.311735    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:40.913548 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:40.913500    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 10:38:40.913737 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:40.913572    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn" podUID="eafa52ae-6ca8-4303-911d-9b15f11b78f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 10:38:41.996244 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:41.996205    2561 generic.go:356] "Generic (PLEG): container finished" podID="eafa52ae-6ca8-4303-911d-9b15f11b78f4" containerID="4a5aab000926dc4dafabd88c3ce94c1ec59203e1260cf55839d08b9e54622527" exitCode=0
Sep 06 10:38:41.996826 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:41.996282    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn" event={"ID":"eafa52ae-6ca8-4303-911d-9b15f11b78f4","Type":"ContainerDied","Data":"4a5aab000926dc4dafabd88c3ce94c1ec59203e1260cf55839d08b9e54622527"}
Sep 06 10:38:41.996826 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:41.996768    2561 scope.go:117] "RemoveContainer" containerID="4a5aab000926dc4dafabd88c3ce94c1ec59203e1260cf55839d08b9e54622527"
Sep 06 10:38:41.998005 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:41.997980    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:38:41.998059 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:41.998044    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:38:41.998098 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:41.998075    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:38:42.925735 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:42.925699    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:43.004236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.004196    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn" event={"ID":"eafa52ae-6ca8-4303-911d-9b15f11b78f4","Type":"ContainerStarted","Data":"d9feec06b1744c1a742c1bf5ee8f15034e033ada28074a114fd4d9c3e3a76220"}
Sep 06 10:38:43.262004 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.261900    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:43.553399 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.553245    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"]
Sep 06 10:38:43.555208 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.555182    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="160689e4-3c5a-4be0-a457-de7df77fccb5" containerName="istio-proxy"
Sep 06 10:38:43.555420 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.555404    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="160689e4-3c5a-4be0-a457-de7df77fccb5" containerName="istio-proxy"
Sep 06 10:38:43.555687 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.555672    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2301b15-52d3-4529-ab00-955235f8fe12" containerName="istio-proxy"
Sep 06 10:38:43.555806 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.555793    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="160689e4-3c5a-4be0-a457-de7df77fccb5" containerName="istio-proxy"
Sep 06 10:38:43.555898 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.555887    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="160689e4-3c5a-4be0-a457-de7df77fccb5" containerName="istio-proxy"
Sep 06 10:38:43.555984 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.555974    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e7ea27e-f8d9-4b83-b8fc-7292f6316cd9" containerName="istio-proxy"
Sep 06 10:38:43.572378 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.572348    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"]
Sep 06 10:38:43.572654 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.572434    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.572904 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.572878    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:43.575247 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.575228    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-71e210-openshift-default-dockercfg-r986l\""
Sep 06 10:38:43.626621 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.626580    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:43.626817 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.626788    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 06 10:38:43.626893 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.626848    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn" podUID="eafa52ae-6ca8-4303-911d-9b15f11b78f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 06 10:38:43.670937 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.670898    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-podinfo\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.671120 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.670949    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-token\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.671120 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.671043    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmfsf\" (UniqueName: \"kubernetes.io/projected/7a85715d-7ba2-4ff6-ad58-d486ce135088-kube-api-access-vmfsf\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.671120 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.671087    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a85715d-7ba2-4ff6-ad58-d486ce135088-istiod-ca-cert\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.671253 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.671176    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-envoy\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.671253 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.671217    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-workload-certs\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.671253 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.671238    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-data\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.671438 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.671310    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-workload-socket\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.671438 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.671370    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-credential-socket\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.772201 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.772160    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-podinfo\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.772201 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.772205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-token\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.772503 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.772364    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmfsf\" (UniqueName: \"kubernetes.io/projected/7a85715d-7ba2-4ff6-ad58-d486ce135088-kube-api-access-vmfsf\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.772503 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.772412    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a85715d-7ba2-4ff6-ad58-d486ce135088-istiod-ca-cert\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.772503 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.772483    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-envoy\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.772676 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.772532    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-workload-certs\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.772676 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.772562    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-data\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.772794 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.772699    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-workload-socket\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.772794 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.772749    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-credential-socket\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.772940 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.772918    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-data\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.774688 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.773586    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a85715d-7ba2-4ff6-ad58-d486ce135088-istiod-ca-cert\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.774688 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.773502    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-workload-socket\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.774688 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.773484    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-workload-certs\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.774688 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.773732    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-credential-socket\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.775352 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.775162    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-podinfo\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.779357 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.775757    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-envoy\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.779357 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.775664    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:43.780547 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.780522    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmfsf\" (UniqueName: \"kubernetes.io/projected/7a85715d-7ba2-4ff6-ad58-d486ce135088-kube-api-access-vmfsf\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.783839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.783815    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-token\") pod \"e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") " pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:43.883451 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:43.883370    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:44.178444 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:44.178416    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"]
Sep 06 10:38:44.179406 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:38:44.179376    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a85715d_7ba2_4ff6_ad58_d486ce135088.slice/crio-ff6c1d02e4f7dc97c139df2d3357aaac719e046f0cabb8397dd2cb59de1471fd WatchSource:0}: Error finding container ff6c1d02e4f7dc97c139df2d3357aaac719e046f0cabb8397dd2cb59de1471fd: Status 404 returned error can't find the container with id ff6c1d02e4f7dc97c139df2d3357aaac719e046f0cabb8397dd2cb59de1471fd
Sep 06 10:38:44.182034 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:44.182000    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:38:44.182113 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:44.182069    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:38:44.182113 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:44.182096    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:38:44.626056 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:44.625969    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 06 10:38:44.626056 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:44.626023    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn" podUID="eafa52ae-6ca8-4303-911d-9b15f11b78f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 06 10:38:45.017757 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:45.017721    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl" event={"ID":"7a85715d-7ba2-4ff6-ad58-d486ce135088","Type":"ContainerStarted","Data":"9e87cfbc2800fb434ba44523670ecac989ad113f90e9378e6b423b93263a9e01"}
Sep 06 10:38:45.017936 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:45.017786    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl" event={"ID":"7a85715d-7ba2-4ff6-ad58-d486ce135088","Type":"ContainerStarted","Data":"ff6c1d02e4f7dc97c139df2d3357aaac719e046f0cabb8397dd2cb59de1471fd"}
Sep 06 10:38:45.039452 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:45.039384    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl" podStartSLOduration=2.039364942 podStartE2EDuration="2.039364942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:38:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:38:45.03545258 +0000 UTC m=+1016.813871994" watchObservedRunningTime="2026-09-06 10:38:45.039364942 +0000 UTC m=+1016.817784357"
Sep 06 10:38:45.626392 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:45.626353    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 06 10:38:45.626768 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:45.626412    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn" podUID="eafa52ae-6ca8-4303-911d-9b15f11b78f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 06 10:38:45.884384 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:45.884290    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:45.889407 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:45.889382    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:46.023908 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:46.023876    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:46.024744 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:46.024726    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:38:46.625972 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:46.625936    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 06 10:38:46.626138 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:46.625989    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn" podUID="eafa52ae-6ca8-4303-911d-9b15f11b78f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 06 10:38:46.952531 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:46.952480    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:47.049596 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:47.049446    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:47.626103 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:47.626065    2561 patch_prober.go:28] interesting pod/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Sep 06 10:38:47.626284 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:47.626120    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn" podUID="eafa52ae-6ca8-4303-911d-9b15f11b78f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Sep 06 10:38:47.987506 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:47.987463    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:48.718450 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:48.718422    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:48.774936 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:48.774902    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:48.782508 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:48.782482    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:48.782764 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:48.782741    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:48.783544 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:48.783514    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:38:49.179506 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:49.179470    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:49.274090 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:49.274051    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:49.532850 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:49.532777    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:49.633515 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:49.633484    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:50.326947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:50.326919    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:50.810475 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:50.810440    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:51.170206 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.170179    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:51.444547 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.444464    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"]
Sep 06 10:38:51.444984 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.444965    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="160689e4-3c5a-4be0-a457-de7df77fccb5" containerName="istio-proxy"
Sep 06 10:38:51.444984 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.444984    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="160689e4-3c5a-4be0-a457-de7df77fccb5" containerName="istio-proxy"
Sep 06 10:38:51.450035 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.450013    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.452337 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.452308    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-682ea0-openshift-default-dockercfg-4xg4z\""
Sep 06 10:38:51.460492 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.460465    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"]
Sep 06 10:38:51.475555 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.475530    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:51.553060 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.553036    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-istio-envoy\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.553187 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.553076    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-credential-socket\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.553187 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.553097    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-workload-socket\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.553261 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.553177    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c9472bf-075b-4340-a149-4f412da39a01-istio-podinfo\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.553261 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.553234    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-workload-certs\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.553342 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.553284    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c9472bf-075b-4340-a149-4f412da39a01-istiod-ca-cert\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.553399 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.553344    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znkxk\" (UniqueName: \"kubernetes.io/projected/6c9472bf-075b-4340-a149-4f412da39a01-kube-api-access-znkxk\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.553399 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.553387    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-istio-data\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.553469 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.553422    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c9472bf-075b-4340-a149-4f412da39a01-istio-token\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.571862 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.571828    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:51.654632 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.654599    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c9472bf-075b-4340-a149-4f412da39a01-istio-podinfo\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.654840 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.654657    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-workload-certs\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.654840 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.654681    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c9472bf-075b-4340-a149-4f412da39a01-istiod-ca-cert\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.654840 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.654704    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znkxk\" (UniqueName: \"kubernetes.io/projected/6c9472bf-075b-4340-a149-4f412da39a01-kube-api-access-znkxk\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.654840 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.654725    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-istio-data\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.654840 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.654758    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c9472bf-075b-4340-a149-4f412da39a01-istio-token\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.654840 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.654798    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-istio-envoy\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.654840 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.654840    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-credential-socket\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.655208 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.654871    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-workload-socket\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.655208 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.655094    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-workload-certs\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.655208 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.655164    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-istio-data\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.655413 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.655246    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-workload-socket\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.655413 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.655271    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-credential-socket\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.655512 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.655444    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c9472bf-075b-4340-a149-4f412da39a01-istiod-ca-cert\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.657030 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.657010    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-istio-envoy\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.657345 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.657311    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c9472bf-075b-4340-a149-4f412da39a01-istio-podinfo\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.661930 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.661906    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c9472bf-075b-4340-a149-4f412da39a01-istio-token\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.662125 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.662103    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znkxk\" (UniqueName: \"kubernetes.io/projected/6c9472bf-075b-4340-a149-4f412da39a01-kube-api-access-znkxk\") pod \"e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") " pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:51.761441 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:51.761333    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:52.043168 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:52.043141    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"]
Sep 06 10:38:52.044545 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:38:52.044512    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c9472bf_075b_4340_a149_4f412da39a01.slice/crio-f13d7bef4aca815730c1f6827cfb26f53eaceec12c01e5872e85328a3f1242ea WatchSource:0}: Error finding container f13d7bef4aca815730c1f6827cfb26f53eaceec12c01e5872e85328a3f1242ea: Status 404 returned error can't find the container with id f13d7bef4aca815730c1f6827cfb26f53eaceec12c01e5872e85328a3f1242ea
Sep 06 10:38:52.046885 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:52.046850    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:38:52.047004 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:52.046912    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:38:52.047004 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:52.046941    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:38:52.063341 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:52.063304    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k" event={"ID":"6c9472bf-075b-4340-a149-4f412da39a01","Type":"ContainerStarted","Data":"f13d7bef4aca815730c1f6827cfb26f53eaceec12c01e5872e85328a3f1242ea"}
Sep 06 10:38:53.077670 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:53.077633    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k" event={"ID":"6c9472bf-075b-4340-a149-4f412da39a01","Type":"ContainerStarted","Data":"f4bd4533a859dc65f059ac0e44b04bf72b870fd24bcb15882bdb0e7ebc55f0e9"}
Sep 06 10:38:53.097885 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:53.097834    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k" podStartSLOduration=2.097820882 podStartE2EDuration="2.097820882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:38:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:38:53.095089847 +0000 UTC m=+1024.873509262" watchObservedRunningTime="2026-09-06 10:38:53.097820882 +0000 UTC m=+1024.876240295"
Sep 06 10:38:53.763444 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:53.763409    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:53.767356 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:53.767311    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:54.083869 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:54.083753    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:54.084688 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:54.084667    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:38:55.007810 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:55.007777    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:55.099367 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:55.099314    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:56.318716 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:56.318685    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:56.419837 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:56.419802    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:56.567215 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:56.567185    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:56.906517 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:56.906485    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:38:57.007354 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:38:57.007306    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:39:02.065599 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:02.065549    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 10:39:02.066011 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:02.065626    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl" podUID="7a85715d-7ba2-4ff6-ad58-d486ce135088" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 10:39:03.161242 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:03.161203    2561 generic.go:356] "Generic (PLEG): container finished" podID="7a85715d-7ba2-4ff6-ad58-d486ce135088" containerID="9e87cfbc2800fb434ba44523670ecac989ad113f90e9378e6b423b93263a9e01" exitCode=0
Sep 06 10:39:03.161687 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:03.161284    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl" event={"ID":"7a85715d-7ba2-4ff6-ad58-d486ce135088","Type":"ContainerDied","Data":"9e87cfbc2800fb434ba44523670ecac989ad113f90e9378e6b423b93263a9e01"}
Sep 06 10:39:03.161807 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:03.161785    2561 scope.go:117] "RemoveContainer" containerID="9e87cfbc2800fb434ba44523670ecac989ad113f90e9378e6b423b93263a9e01"
Sep 06 10:39:03.163083 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:03.163053    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:39:03.163146 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:03.163132    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:39:03.163181 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:03.163168    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:39:04.179856 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:04.179808    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl" event={"ID":"7a85715d-7ba2-4ff6-ad58-d486ce135088","Type":"ContainerStarted","Data":"b216bef472cacd038f2af308724f7b7441f7fb036fd7627ab4bf76390c956a2a"}
Sep 06 10:39:04.884577 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:04.884536    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:39:04.884808 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:04.884777    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 06 10:39:04.884885 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:04.884843    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl" podUID="7a85715d-7ba2-4ff6-ad58-d486ce135088" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 06 10:39:05.884167 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:05.884115    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 06 10:39:05.884699 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:05.884194    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl" podUID="7a85715d-7ba2-4ff6-ad58-d486ce135088" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 06 10:39:06.884316 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:06.884274    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 06 10:39:06.884755 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:06.884367    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl" podUID="7a85715d-7ba2-4ff6-ad58-d486ce135088" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 06 10:39:07.884425 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:07.884382    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 06 10:39:07.884813 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:07.884445    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl" podUID="7a85715d-7ba2-4ff6-ad58-d486ce135088" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 06 10:39:08.884203 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:08.884166    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Sep 06 10:39:08.884429 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:08.884228    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl" podUID="7a85715d-7ba2-4ff6-ad58-d486ce135088" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Sep 06 10:39:09.656593 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:09.656564    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:39:09.888080 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:09.888052    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:39:09.888437 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:09.888410    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:39:09.889176 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:09.889155    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:39:10.126500 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:10.126419    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 10:39:10.126500 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:10.126482    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k" podUID="6c9472bf-075b-4340-a149-4f412da39a01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 10:39:11.228461 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:11.228424    2561 generic.go:356] "Generic (PLEG): container finished" podID="6c9472bf-075b-4340-a149-4f412da39a01" containerID="f4bd4533a859dc65f059ac0e44b04bf72b870fd24bcb15882bdb0e7ebc55f0e9" exitCode=0
Sep 06 10:39:11.228881 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:11.228497    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k" event={"ID":"6c9472bf-075b-4340-a149-4f412da39a01","Type":"ContainerDied","Data":"f4bd4533a859dc65f059ac0e44b04bf72b870fd24bcb15882bdb0e7ebc55f0e9"}
Sep 06 10:39:11.229065 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:11.229048    2561 scope.go:117] "RemoveContainer" containerID="f4bd4533a859dc65f059ac0e44b04bf72b870fd24bcb15882bdb0e7ebc55f0e9"
Sep 06 10:39:11.230166 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:11.230137    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:39:11.230239 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:11.230224    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:39:11.230276 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:11.230266    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:39:11.953648 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:11.953602    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:39:12.239269 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:12.239162    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k" event={"ID":"6c9472bf-075b-4340-a149-4f412da39a01","Type":"ContainerStarted","Data":"e5a1f71a1b2aedb954265888942e27a0228a3ef8b16782f52e5893b9176c56f3"}
Sep 06 10:39:12.617983 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:12.617900    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7837-140254534419920"]
Sep 06 10:39:12.620205 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:12.620189    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7837-140254534419920"
Sep 06 10:39:12.623119 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:12.623092    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-728g6\""
Sep 06 10:39:12.625915 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:12.625889    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7837-140254534419920"]
Sep 06 10:39:12.668614 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:12.668564    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtxf6\" (UniqueName: \"kubernetes.io/projected/c5eb7487-1ec4-49b2-94c4-0436a070c502-kube-api-access-wtxf6\") pod \"test-curl-7837-140254534419920\" (UID: \"c5eb7487-1ec4-49b2-94c4-0436a070c502\") " pod="opendatahub/test-curl-7837-140254534419920"
Sep 06 10:39:12.762530 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:12.762500    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 06 10:39:12.762724 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:12.762559    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k" podUID="6c9472bf-075b-4340-a149-4f412da39a01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 06 10:39:12.767947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:12.767918    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:39:12.769234 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:12.769212    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtxf6\" (UniqueName: \"kubernetes.io/projected/c5eb7487-1ec4-49b2-94c4-0436a070c502-kube-api-access-wtxf6\") pod \"test-curl-7837-140254534419920\" (UID: \"c5eb7487-1ec4-49b2-94c4-0436a070c502\") " pod="opendatahub/test-curl-7837-140254534419920"
Sep 06 10:39:12.780759 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:12.780732    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtxf6\" (UniqueName: \"kubernetes.io/projected/c5eb7487-1ec4-49b2-94c4-0436a070c502-kube-api-access-wtxf6\") pod \"test-curl-7837-140254534419920\" (UID: \"c5eb7487-1ec4-49b2-94c4-0436a070c502\") " pod="opendatahub/test-curl-7837-140254534419920"
Sep 06 10:39:12.931864 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:12.931834    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7837-140254534419920"
Sep 06 10:39:13.219932 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:13.219844    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7837-140254534419920"]
Sep 06 10:39:13.223745 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:39:13.223709    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5eb7487_1ec4_49b2_94c4_0436a070c502.slice/crio-b7190a70d13d5df865a83be647edd575b49f362b2d06cbf8880cbd6486a96577 WatchSource:0}: Error finding container b7190a70d13d5df865a83be647edd575b49f362b2d06cbf8880cbd6486a96577: Status 404 returned error can't find the container with id b7190a70d13d5df865a83be647edd575b49f362b2d06cbf8880cbd6486a96577
Sep 06 10:39:13.225285 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:13.225266    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 10:39:13.256825 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:13.256780    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7837-140254534419920" event={"ID":"c5eb7487-1ec4-49b2-94c4-0436a070c502","Type":"ContainerStarted","Data":"b7190a70d13d5df865a83be647edd575b49f362b2d06cbf8880cbd6486a96577"}
Sep 06 10:39:13.762218 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:13.762177    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 06 10:39:13.762450 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:13.762237    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k" podUID="6c9472bf-075b-4340-a149-4f412da39a01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 06 10:39:14.762881 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:14.762735    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 06 10:39:14.762881 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:14.762796    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k" podUID="6c9472bf-075b-4340-a149-4f412da39a01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 06 10:39:15.762511 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:15.762466    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 06 10:39:15.762703 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:15.762547    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k" podUID="6c9472bf-075b-4340-a149-4f412da39a01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 06 10:39:16.281379 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:16.281341    2561 generic.go:356] "Generic (PLEG): container finished" podID="c5eb7487-1ec4-49b2-94c4-0436a070c502" containerID="2560ca4b6e7d5e4504a0409a8773706b263777c3ca25d32829ce8c23094c135d" exitCode=0
Sep 06 10:39:16.281784 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:16.281430    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7837-140254534419920" event={"ID":"c5eb7487-1ec4-49b2-94c4-0436a070c502","Type":"ContainerDied","Data":"2560ca4b6e7d5e4504a0409a8773706b263777c3ca25d32829ce8c23094c135d"}
Sep 06 10:39:16.762788 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:16.762746    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 06 10:39:16.762990 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:16.762808    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k" podUID="6c9472bf-075b-4340-a149-4f412da39a01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 06 10:39:17.298124 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.298088    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:39:17.448195 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.448166    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7837-140254534419920"
Sep 06 10:39:17.466867 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.466816    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7837-140254534419920_c5eb7487-1ec4-49b2-94c4-0436a070c502/test-curl-7837-140254534419920/0.log"
Sep 06 10:39:17.488059 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.488017    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7837-140254534419920"]
Sep 06 10:39:17.492710 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.492683    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7837-140254534419920"]
Sep 06 10:39:17.520802 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.520774    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtxf6\" (UniqueName: \"kubernetes.io/projected/c5eb7487-1ec4-49b2-94c4-0436a070c502-kube-api-access-wtxf6\") pod \"c5eb7487-1ec4-49b2-94c4-0436a070c502\" (UID: \"c5eb7487-1ec4-49b2-94c4-0436a070c502\") "
Sep 06 10:39:17.522945 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.522917    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5eb7487-1ec4-49b2-94c4-0436a070c502-kube-api-access-wtxf6" (OuterVolumeSpecName: "kube-api-access-wtxf6") pod "c5eb7487-1ec4-49b2-94c4-0436a070c502" (UID: "c5eb7487-1ec4-49b2-94c4-0436a070c502"). InnerVolumeSpecName "kube-api-access-wtxf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:39:17.614389 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.614288    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7837-140254534419920"]
Sep 06 10:39:17.614746 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.614731    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5eb7487-1ec4-49b2-94c4-0436a070c502" containerName="test-curl-7837-140254534419920"
Sep 06 10:39:17.614798 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.614747    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5eb7487-1ec4-49b2-94c4-0436a070c502" containerName="test-curl-7837-140254534419920"
Sep 06 10:39:17.614842 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.614824    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5eb7487-1ec4-49b2-94c4-0436a070c502" containerName="test-curl-7837-140254534419920"
Sep 06 10:39:17.617743 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.617728    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7837-140254534419920"
Sep 06 10:39:17.621947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.621918    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtxf6\" (UniqueName: \"kubernetes.io/projected/c5eb7487-1ec4-49b2-94c4-0436a070c502-kube-api-access-wtxf6\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:39:17.625031 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.625005    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7837-140254534419920"]
Sep 06 10:39:17.722947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.722888    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l95pv\" (UniqueName: \"kubernetes.io/projected/4773d976-10f9-420e-a35c-49f85688f817-kube-api-access-l95pv\") pod \"test-curl-7837-140254534419920\" (UID: \"4773d976-10f9-420e-a35c-49f85688f817\") " pod="opendatahub/test-curl-7837-140254534419920"
Sep 06 10:39:17.766000 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.765970    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:39:17.766239 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.766219    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:39:17.766844 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.766829    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:39:17.823525 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.823496    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l95pv\" (UniqueName: \"kubernetes.io/projected/4773d976-10f9-420e-a35c-49f85688f817-kube-api-access-l95pv\") pod \"test-curl-7837-140254534419920\" (UID: \"4773d976-10f9-420e-a35c-49f85688f817\") " pod="opendatahub/test-curl-7837-140254534419920"
Sep 06 10:39:17.834978 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.834947    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l95pv\" (UniqueName: \"kubernetes.io/projected/4773d976-10f9-420e-a35c-49f85688f817-kube-api-access-l95pv\") pod \"test-curl-7837-140254534419920\" (UID: \"4773d976-10f9-420e-a35c-49f85688f817\") " pod="opendatahub/test-curl-7837-140254534419920"
Sep 06 10:39:17.930941 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:17.930907    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7837-140254534419920"
Sep 06 10:39:18.205911 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:18.205882    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7837-140254534419920"]
Sep 06 10:39:18.206977 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:39:18.206952    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4773d976_10f9_420e_a35c_49f85688f817.slice/crio-a885e9b98cb3dd0d6c55d314d07ad0c842145cd97074738545e4dddf890aef50 WatchSource:0}: Error finding container a885e9b98cb3dd0d6c55d314d07ad0c842145cd97074738545e4dddf890aef50: Status 404 returned error can't find the container with id a885e9b98cb3dd0d6c55d314d07ad0c842145cd97074738545e4dddf890aef50
Sep 06 10:39:18.294763 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:18.294728    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7837-140254534419920" event={"ID":"4773d976-10f9-420e-a35c-49f85688f817","Type":"ContainerStarted","Data":"a885e9b98cb3dd0d6c55d314d07ad0c842145cd97074738545e4dddf890aef50"}
Sep 06 10:39:18.296021 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:18.296002    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7837-140254534419920"
Sep 06 10:39:18.296144 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:18.296034    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7190a70d13d5df865a83be647edd575b49f362b2d06cbf8880cbd6486a96577"
Sep 06 10:39:18.307201 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:18.307175    2561 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7837-140254534419920" oldPodUID="c5eb7487-1ec4-49b2-94c4-0436a070c502" podUID="4773d976-10f9-420e-a35c-49f85688f817"
Sep 06 10:39:18.758486 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:18.758459    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5eb7487-1ec4-49b2-94c4-0436a070c502" path="/var/lib/kubelet/pods/c5eb7487-1ec4-49b2-94c4-0436a070c502/volumes"
Sep 06 10:39:19.303735 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:19.303700    2561 generic.go:356] "Generic (PLEG): container finished" podID="4773d976-10f9-420e-a35c-49f85688f817" containerID="fb0698d793434b777afa72fc6d0ce6570b117a56b5430803691ba386a7b47f38" exitCode=0
Sep 06 10:39:19.303915 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:19.303791    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7837-140254534419920" event={"ID":"4773d976-10f9-420e-a35c-49f85688f817","Type":"ContainerDied","Data":"fb0698d793434b777afa72fc6d0ce6570b117a56b5430803691ba386a7b47f38"}
Sep 06 10:39:19.996559 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:19.996527    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:39:20.434424 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:20.434400    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7837-140254534419920"
Sep 06 10:39:20.453413 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:20.453380    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7837-140254534419920_4773d976-10f9-420e-a35c-49f85688f817/test-curl-7837-140254534419920/0.log"
Sep 06 10:39:20.480814 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:20.480786    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7837-140254534419920"]
Sep 06 10:39:20.483275 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:20.483255    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7837-140254534419920"]
Sep 06 10:39:20.552135 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:20.552102    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l95pv\" (UniqueName: \"kubernetes.io/projected/4773d976-10f9-420e-a35c-49f85688f817-kube-api-access-l95pv\") pod \"4773d976-10f9-420e-a35c-49f85688f817\" (UID: \"4773d976-10f9-420e-a35c-49f85688f817\") "
Sep 06 10:39:20.554129 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:20.554101    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4773d976-10f9-420e-a35c-49f85688f817-kube-api-access-l95pv" (OuterVolumeSpecName: "kube-api-access-l95pv") pod "4773d976-10f9-420e-a35c-49f85688f817" (UID: "4773d976-10f9-420e-a35c-49f85688f817"). InnerVolumeSpecName "kube-api-access-l95pv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:39:20.601732 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:20.601671    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7837-140254534420496"]
Sep 06 10:39:20.602089 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:20.602075    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4773d976-10f9-420e-a35c-49f85688f817" containerName="test-curl-7837-140254534419920"
Sep 06 10:39:20.602127 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:20.602091    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4773d976-10f9-420e-a35c-49f85688f817" containerName="test-curl-7837-140254534419920"
Sep 06 10:39:20.602189 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:20.602179    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4773d976-10f9-420e-a35c-49f85688f817" containerName="test-curl-7837-140254534419920"
Sep 06 10:39:20.605150 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:20.605134    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7837-140254534420496"
Sep 06 10:39:20.609277 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:20.609251    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7837-140254534420496"]
Sep 06 10:39:20.653067 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:20.653039    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l95pv\" (UniqueName: \"kubernetes.io/projected/4773d976-10f9-420e-a35c-49f85688f817-kube-api-access-l95pv\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:39:20.753699 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:20.753661    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmhmr\" (UniqueName: \"kubernetes.io/projected/d675d937-817e-4a2a-a8f2-cfe7d9121a81-kube-api-access-mmhmr\") pod \"test-curl-7837-140254534420496\" (UID: \"d675d937-817e-4a2a-a8f2-cfe7d9121a81\") " pod="opendatahub/test-curl-7837-140254534420496"
Sep 06 10:39:20.755729 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:20.755702    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4773d976-10f9-420e-a35c-49f85688f817" path="/var/lib/kubelet/pods/4773d976-10f9-420e-a35c-49f85688f817/volumes"
Sep 06 10:39:20.854284 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:20.854208    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmhmr\" (UniqueName: \"kubernetes.io/projected/d675d937-817e-4a2a-a8f2-cfe7d9121a81-kube-api-access-mmhmr\") pod \"test-curl-7837-140254534420496\" (UID: \"d675d937-817e-4a2a-a8f2-cfe7d9121a81\") " pod="opendatahub/test-curl-7837-140254534420496"
Sep 06 10:39:20.871022 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:20.870997    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmhmr\" (UniqueName: \"kubernetes.io/projected/d675d937-817e-4a2a-a8f2-cfe7d9121a81-kube-api-access-mmhmr\") pod \"test-curl-7837-140254534420496\" (UID: \"d675d937-817e-4a2a-a8f2-cfe7d9121a81\") " pod="opendatahub/test-curl-7837-140254534420496"
Sep 06 10:39:20.916865 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:20.916838    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7837-140254534420496"
Sep 06 10:39:21.186888 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:21.186864    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7837-140254534420496"]
Sep 06 10:39:21.188772 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:39:21.188747    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd675d937_817e_4a2a_a8f2_cfe7d9121a81.slice/crio-ff79c785c0295b6fc33860595792b92d6211c2e77e102a98386c769babd5ecb1 WatchSource:0}: Error finding container ff79c785c0295b6fc33860595792b92d6211c2e77e102a98386c769babd5ecb1: Status 404 returned error can't find the container with id ff79c785c0295b6fc33860595792b92d6211c2e77e102a98386c769babd5ecb1
Sep 06 10:39:21.317568 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:21.317537    2561 scope.go:117] "RemoveContainer" containerID="fb0698d793434b777afa72fc6d0ce6570b117a56b5430803691ba386a7b47f38"
Sep 06 10:39:21.317753 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:21.317538    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7837-140254534419920"
Sep 06 10:39:21.318959 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:21.318934    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7837-140254534420496" event={"ID":"d675d937-817e-4a2a-a8f2-cfe7d9121a81","Type":"ContainerStarted","Data":"ff79c785c0295b6fc33860595792b92d6211c2e77e102a98386c769babd5ecb1"}
Sep 06 10:39:22.327965 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:22.327926    2561 generic.go:356] "Generic (PLEG): container finished" podID="d675d937-817e-4a2a-a8f2-cfe7d9121a81" containerID="87d54215f9e81b8663826b7b329a7fd272dd0e0a3b3e3736ad9f3b0dd9b2e49d" exitCode=0
Sep 06 10:39:22.328357 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:22.327982    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7837-140254534420496" event={"ID":"d675d937-817e-4a2a-a8f2-cfe7d9121a81","Type":"ContainerDied","Data":"87d54215f9e81b8663826b7b329a7fd272dd0e0a3b3e3736ad9f3b0dd9b2e49d"}
Sep 06 10:39:23.465167 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:23.465139    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7837-140254534420496"
Sep 06 10:39:23.483228 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:23.483201    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7837-140254534420496_d675d937-817e-4a2a-a8f2-cfe7d9121a81/test-curl-7837-140254534420496/0.log"
Sep 06 10:39:23.505249 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:23.505218    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7837-140254534420496"]
Sep 06 10:39:23.509440 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:23.509413    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7837-140254534420496"]
Sep 06 10:39:23.581471 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:23.581441    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmhmr\" (UniqueName: \"kubernetes.io/projected/d675d937-817e-4a2a-a8f2-cfe7d9121a81-kube-api-access-mmhmr\") pod \"d675d937-817e-4a2a-a8f2-cfe7d9121a81\" (UID: \"d675d937-817e-4a2a-a8f2-cfe7d9121a81\") "
Sep 06 10:39:23.583465 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:23.583440    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d675d937-817e-4a2a-a8f2-cfe7d9121a81-kube-api-access-mmhmr" (OuterVolumeSpecName: "kube-api-access-mmhmr") pod "d675d937-817e-4a2a-a8f2-cfe7d9121a81" (UID: "d675d937-817e-4a2a-a8f2-cfe7d9121a81"). InnerVolumeSpecName "kube-api-access-mmhmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:39:23.628279 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:23.628254    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7837-140254534420496"]
Sep 06 10:39:23.628793 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:23.628774    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d675d937-817e-4a2a-a8f2-cfe7d9121a81" containerName="test-curl-7837-140254534420496"
Sep 06 10:39:23.628878 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:23.628795    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d675d937-817e-4a2a-a8f2-cfe7d9121a81" containerName="test-curl-7837-140254534420496"
Sep 06 10:39:23.628934 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:23.628896    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d675d937-817e-4a2a-a8f2-cfe7d9121a81" containerName="test-curl-7837-140254534420496"
Sep 06 10:39:23.631960 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:23.631943    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7837-140254534420496"
Sep 06 10:39:23.637596 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:23.637577    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7837-140254534420496"]
Sep 06 10:39:23.683189 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:23.683165    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmhmr\" (UniqueName: \"kubernetes.io/projected/d675d937-817e-4a2a-a8f2-cfe7d9121a81-kube-api-access-mmhmr\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:39:23.784589 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:23.784559    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88zpz\" (UniqueName: \"kubernetes.io/projected/c62bf284-b228-4aa2-b656-db791fa5d13c-kube-api-access-88zpz\") pod \"test-curl-7837-140254534420496\" (UID: \"c62bf284-b228-4aa2-b656-db791fa5d13c\") " pod="opendatahub/test-curl-7837-140254534420496"
Sep 06 10:39:23.885351 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:23.885274    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88zpz\" (UniqueName: \"kubernetes.io/projected/c62bf284-b228-4aa2-b656-db791fa5d13c-kube-api-access-88zpz\") pod \"test-curl-7837-140254534420496\" (UID: \"c62bf284-b228-4aa2-b656-db791fa5d13c\") " pod="opendatahub/test-curl-7837-140254534420496"
Sep 06 10:39:23.893179 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:23.893152    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88zpz\" (UniqueName: \"kubernetes.io/projected/c62bf284-b228-4aa2-b656-db791fa5d13c-kube-api-access-88zpz\") pod \"test-curl-7837-140254534420496\" (UID: \"c62bf284-b228-4aa2-b656-db791fa5d13c\") " pod="opendatahub/test-curl-7837-140254534420496"
Sep 06 10:39:23.942900 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:23.942876    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7837-140254534420496"
Sep 06 10:39:24.214214 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:24.214178    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7837-140254534420496"]
Sep 06 10:39:24.219345 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:39:24.219297    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc62bf284_b228_4aa2_b656_db791fa5d13c.slice/crio-aeff5988f4d877533cda284d731b95e44d4e5056b2470223f1b95308d0d8f955 WatchSource:0}: Error finding container aeff5988f4d877533cda284d731b95e44d4e5056b2470223f1b95308d0d8f955: Status 404 returned error can't find the container with id aeff5988f4d877533cda284d731b95e44d4e5056b2470223f1b95308d0d8f955
Sep 06 10:39:24.341168 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:24.341139    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7837-140254534420496"
Sep 06 10:39:24.341356 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:24.341154    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff79c785c0295b6fc33860595792b92d6211c2e77e102a98386c769babd5ecb1"
Sep 06 10:39:24.342699 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:24.342671    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7837-140254534420496" event={"ID":"c62bf284-b228-4aa2-b656-db791fa5d13c","Type":"ContainerStarted","Data":"aeff5988f4d877533cda284d731b95e44d4e5056b2470223f1b95308d0d8f955"}
Sep 06 10:39:24.352647 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:24.352622    2561 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7837-140254534420496" oldPodUID="d675d937-817e-4a2a-a8f2-cfe7d9121a81" podUID="c62bf284-b228-4aa2-b656-db791fa5d13c"
Sep 06 10:39:24.754197 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:24.754170    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d675d937-817e-4a2a-a8f2-cfe7d9121a81" path="/var/lib/kubelet/pods/d675d937-817e-4a2a-a8f2-cfe7d9121a81/volumes"
Sep 06 10:39:25.350959 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:25.350922    2561 generic.go:356] "Generic (PLEG): container finished" podID="c62bf284-b228-4aa2-b656-db791fa5d13c" containerID="e2cfb7330624ff49b774510e15aefef8232ef4019018bd3650a4a7233c5742bd" exitCode=0
Sep 06 10:39:25.351138 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:25.350964    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7837-140254534420496" event={"ID":"c62bf284-b228-4aa2-b656-db791fa5d13c","Type":"ContainerDied","Data":"e2cfb7330624ff49b774510e15aefef8232ef4019018bd3650a4a7233c5742bd"}
Sep 06 10:39:26.491499 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:26.491473    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7837-140254534420496"
Sep 06 10:39:26.510857 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:26.510825    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7837-140254534420496_c62bf284-b228-4aa2-b656-db791fa5d13c/test-curl-7837-140254534420496/0.log"
Sep 06 10:39:26.533521 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:26.533494    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7837-140254534420496"]
Sep 06 10:39:26.539083 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:26.539062    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7837-140254534420496"]
Sep 06 10:39:26.613730 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:26.613673    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88zpz\" (UniqueName: \"kubernetes.io/projected/c62bf284-b228-4aa2-b656-db791fa5d13c-kube-api-access-88zpz\") pod \"c62bf284-b228-4aa2-b656-db791fa5d13c\" (UID: \"c62bf284-b228-4aa2-b656-db791fa5d13c\") "
Sep 06 10:39:26.615727 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:26.615699    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c62bf284-b228-4aa2-b656-db791fa5d13c-kube-api-access-88zpz" (OuterVolumeSpecName: "kube-api-access-88zpz") pod "c62bf284-b228-4aa2-b656-db791fa5d13c" (UID: "c62bf284-b228-4aa2-b656-db791fa5d13c"). InnerVolumeSpecName "kube-api-access-88zpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:39:26.714717 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:26.714687    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88zpz\" (UniqueName: \"kubernetes.io/projected/c62bf284-b228-4aa2-b656-db791fa5d13c-kube-api-access-88zpz\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:39:26.755708 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:26.755675    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c62bf284-b228-4aa2-b656-db791fa5d13c" path="/var/lib/kubelet/pods/c62bf284-b228-4aa2-b656-db791fa5d13c/volumes"
Sep 06 10:39:27.142104 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.142072    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:39:27.364492 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.364462    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7837-140254534420496"
Sep 06 10:39:27.364492 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.364489    2561 scope.go:117] "RemoveContainer" containerID="e2cfb7330624ff49b774510e15aefef8232ef4019018bd3650a4a7233c5742bd"
Sep 06 10:39:27.422100 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.422064    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"]
Sep 06 10:39:27.422569 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.422552    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c62bf284-b228-4aa2-b656-db791fa5d13c" containerName="test-curl-7837-140254534420496"
Sep 06 10:39:27.422682 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.422571    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c62bf284-b228-4aa2-b656-db791fa5d13c" containerName="test-curl-7837-140254534420496"
Sep 06 10:39:27.422743 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.422682    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c62bf284-b228-4aa2-b656-db791fa5d13c" containerName="test-curl-7837-140254534420496"
Sep 06 10:39:27.427288 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.427267    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.429436 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.429408    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b21e0db6-openshift-default-dockercfg-s5kv9\""
Sep 06 10:39:27.440052 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.440028    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"]
Sep 06 10:39:27.471273 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.471240    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:39:27.522762 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.522706    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqxxc\" (UniqueName: \"kubernetes.io/projected/f39ce5ea-dd28-4857-a433-613a79dcef71-kube-api-access-cqxxc\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.523229 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.522790    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-envoy\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.523229 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.522821    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-podinfo\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.523229 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.522849    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-token\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.523229 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.522875    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-workload-socket\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.523229 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.522900    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-workload-certs\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.523229 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.522940    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f39ce5ea-dd28-4857-a433-613a79dcef71-istiod-ca-cert\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.523229 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.523024    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-credential-socket\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.523229 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.523061    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-data\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.624037 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.624000    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-data\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.624200 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.624096    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqxxc\" (UniqueName: \"kubernetes.io/projected/f39ce5ea-dd28-4857-a433-613a79dcef71-kube-api-access-cqxxc\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.624200 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.624132    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-envoy\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.624200 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.624150    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-podinfo\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.624200 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.624167    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-token\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.624200 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.624183    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-workload-socket\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.624502 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.624202    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-workload-certs\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.624502 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.624258    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f39ce5ea-dd28-4857-a433-613a79dcef71-istiod-ca-cert\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.624502 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.624460    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-data\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.624672 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.624513    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-credential-socket\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.624672 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.624557    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-workload-certs\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.624672 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.624661    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-workload-socket\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.624855 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.624832    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-credential-socket\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.624986 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.624969    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f39ce5ea-dd28-4857-a433-613a79dcef71-istiod-ca-cert\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.626902 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.626882    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-envoy\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.627050 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.627034    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-podinfo\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.632988 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.632965    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqxxc\" (UniqueName: \"kubernetes.io/projected/f39ce5ea-dd28-4857-a433-613a79dcef71-kube-api-access-cqxxc\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.633066 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.632986    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-token\") pod \"e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") " pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.740884 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.740844    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:27.948101 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:27.948018    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:39:28.040624 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:28.040594    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"]
Sep 06 10:39:28.045609 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:39:28.045579    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf39ce5ea_dd28_4857_a433_613a79dcef71.slice/crio-08cc9eb00c5e5edebf35060353014b43c87e3125d6d78629d3b9e9b2f5bd5bf8 WatchSource:0}: Error finding container 08cc9eb00c5e5edebf35060353014b43c87e3125d6d78629d3b9e9b2f5bd5bf8: Status 404 returned error can't find the container with id 08cc9eb00c5e5edebf35060353014b43c87e3125d6d78629d3b9e9b2f5bd5bf8
Sep 06 10:39:28.048027 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:28.047997    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:39:28.048132 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:28.048055    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:39:28.048132 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:28.048084    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:39:28.373976 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:28.373879    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn" event={"ID":"f39ce5ea-dd28-4857-a433-613a79dcef71","Type":"ContainerStarted","Data":"988438d012de35e4f58cf908d59897a26d5f1fd6850995bbc4f4c664c8fbe912"}
Sep 06 10:39:28.373976 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:28.373942    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn" event={"ID":"f39ce5ea-dd28-4857-a433-613a79dcef71","Type":"ContainerStarted","Data":"08cc9eb00c5e5edebf35060353014b43c87e3125d6d78629d3b9e9b2f5bd5bf8"}
Sep 06 10:39:28.394303 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:28.394252    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn" podStartSLOduration=1.394234204 podStartE2EDuration="1.394234204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:39:28.392347052 +0000 UTC m=+1060.170766591" watchObservedRunningTime="2026-09-06 10:39:28.394234204 +0000 UTC m=+1060.172653618"
Sep 06 10:39:28.740974 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:28.740940    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:29.746762 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:29.746728    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:30.296010 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:30.295961    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:39:30.386865 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:30.386840    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:30.387795 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:30.387777    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:30.390771 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:30.390749    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:39:31.456020 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:31.455987    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:39:31.561260 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:31.561226    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:39:31.656381 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:31.656347    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:39:31.951783 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:31.951735    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:39:32.015866 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:32.015834    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:39:44.355404 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:44.354734    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:39:46.428482 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:46.428445    2561 patch_prober.go:28] interesting pod/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 10:39:46.428977 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:46.428510    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn" podUID="f39ce5ea-dd28-4857-a433-613a79dcef71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 10:39:48.514311 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:48.514279    2561 generic.go:356] "Generic (PLEG): container finished" podID="f39ce5ea-dd28-4857-a433-613a79dcef71" containerID="988438d012de35e4f58cf908d59897a26d5f1fd6850995bbc4f4c664c8fbe912" exitCode=0
Sep 06 10:39:48.514747 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:48.514348    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn" event={"ID":"f39ce5ea-dd28-4857-a433-613a79dcef71","Type":"ContainerDied","Data":"988438d012de35e4f58cf908d59897a26d5f1fd6850995bbc4f4c664c8fbe912"}
Sep 06 10:39:48.514791 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:48.514762    2561 scope.go:117] "RemoveContainer" containerID="988438d012de35e4f58cf908d59897a26d5f1fd6850995bbc4f4c664c8fbe912"
Sep 06 10:39:48.515894 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:48.515865    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:39:48.515989 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:48.515970    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:39:48.516053 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:48.516019    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:39:48.875670 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:48.875597    2561 scope.go:117] "RemoveContainer" containerID="f7a461ab9222cb9086e193ed90f104504bd9ea88f3fdfc76646d206f48e8abd5"
Sep 06 10:39:49.522883 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:49.522850    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn" event={"ID":"f39ce5ea-dd28-4857-a433-613a79dcef71","Type":"ContainerStarted","Data":"c9b279c3922f532ebfcad9543baad1ee20ddfb73f0f90e8d63d3c5c100459b77"}
Sep 06 10:39:49.741582 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:49.741538    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:49.742090 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:49.742063    2561 patch_prober.go:28] interesting pod/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 06 10:39:49.742290 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:49.742264    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn" podUID="f39ce5ea-dd28-4857-a433-613a79dcef71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 06 10:39:50.741482 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:50.741441    2561 patch_prober.go:28] interesting pod/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 06 10:39:50.742077 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:50.742043    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn" podUID="f39ce5ea-dd28-4857-a433-613a79dcef71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 06 10:39:51.741725 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:51.741691    2561 patch_prober.go:28] interesting pod/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 06 10:39:51.742695 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:51.742257    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn" podUID="f39ce5ea-dd28-4857-a433-613a79dcef71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 06 10:39:52.748748 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:52.748702    2561 patch_prober.go:28] interesting pod/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 06 10:39:52.749255 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:52.748770    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn" podUID="f39ce5ea-dd28-4857-a433-613a79dcef71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 06 10:39:53.221526 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:53.221491    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:39:53.741297 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:53.741258    2561 patch_prober.go:28] interesting pod/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 06 10:39:53.741625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:53.741593    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn" podUID="f39ce5ea-dd28-4857-a433-613a79dcef71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 06 10:39:54.741870 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:54.741828    2561 patch_prober.go:28] interesting pod/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 06 10:39:54.742507 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:54.742474    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn" podUID="f39ce5ea-dd28-4857-a433-613a79dcef71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 06 10:39:55.262358 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:55.262308    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:39:55.745400 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:55.745363    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:55.745796 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:55.745776    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:39:55.747277 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:39:55.747257    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:40:07.988148 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:07.988111    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"]
Sep 06 10:40:07.993677 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:07.993653    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:07.997002 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:07.996972    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b21e0db6\"/\"default-dockercfg-8z2v5\""
Sep 06 10:40:07.997139 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:07.997045    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b21e0db6\"/\"openshift-service-ca.crt\""
Sep 06 10:40:07.997139 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:07.997122    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b21e0db6\"/\"kube-root-ca.crt\""
Sep 06 10:40:07.997266 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:07.997217    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b21e0db6\"/\"e2e-lifecycle-model-b21e0db6-kserve-self-signed-certs\""
Sep 06 10:40:08.002002 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.001976    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"]
Sep 06 10:40:08.027472 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.027443    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:40:08.149754 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.149364    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qcwz\" (UniqueName: \"kubernetes.io/projected/922cc6e8-1b28-4833-a9b1-7825293478c8-kube-api-access-2qcwz\") pod \"e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") " pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:08.149754 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.149445    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-home\") pod \"e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") " pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:08.149754 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.149497    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-dshm\") pod \"e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") " pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:08.149754 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.149525    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-model-cache\") pod \"e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") " pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:08.149754 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.149631    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/922cc6e8-1b28-4833-a9b1-7825293478c8-tls-certs\") pod \"e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") " pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:08.149754 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.149678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-tmp-dir\") pod \"e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") " pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:08.250404 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.250297    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-dshm\") pod \"e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") " pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:08.250404 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.250364    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-model-cache\") pod \"e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") " pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:08.250588 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.250420    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/922cc6e8-1b28-4833-a9b1-7825293478c8-tls-certs\") pod \"e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") " pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:08.250588 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.250454    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-tmp-dir\") pod \"e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") " pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:08.250588 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.250491    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qcwz\" (UniqueName: \"kubernetes.io/projected/922cc6e8-1b28-4833-a9b1-7825293478c8-kube-api-access-2qcwz\") pod \"e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") " pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:08.250746 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.250615    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-home\") pod \"e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") " pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:08.250813 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.250792    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-model-cache\") pod \"e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") " pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:08.250868 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.250853    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-tmp-dir\") pod \"e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") " pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:08.250958 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.250927    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-home\") pod \"e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") " pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:08.252624 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.252600    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-dshm\") pod \"e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") " pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:08.253024 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.253003    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/922cc6e8-1b28-4833-a9b1-7825293478c8-tls-certs\") pod \"e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") " pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:08.257960 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.257939    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qcwz\" (UniqueName: \"kubernetes.io/projected/922cc6e8-1b28-4833-a9b1-7825293478c8-kube-api-access-2qcwz\") pod \"e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") " pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:08.306692 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.306670    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:08.579522 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.579492    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"]
Sep 06 10:40:08.580598 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:40:08.580571    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod922cc6e8_1b28_4833_a9b1_7825293478c8.slice/crio-72ce66f4844c4e631bc11c758665c24985781e88d425676c55b0bc36daf67dfe WatchSource:0}: Error finding container 72ce66f4844c4e631bc11c758665c24985781e88d425676c55b0bc36daf67dfe: Status 404 returned error can't find the container with id 72ce66f4844c4e631bc11c758665c24985781e88d425676c55b0bc36daf67dfe
Sep 06 10:40:08.655838 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.655808    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv" event={"ID":"922cc6e8-1b28-4833-a9b1-7825293478c8","Type":"ContainerStarted","Data":"7ee20271fd487689da9df866ce324883881fe36006886118e9dd8e2368be44c7"}
Sep 06 10:40:08.655971 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.655854    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv" event={"ID":"922cc6e8-1b28-4833-a9b1-7825293478c8","Type":"ContainerStarted","Data":"72ce66f4844c4e631bc11c758665c24985781e88d425676c55b0bc36daf67dfe"}
Sep 06 10:40:08.674086 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:08.674042    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv" podStartSLOduration=1.6740265189999999 podStartE2EDuration="1.674026519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:40:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:40:08.670919575 +0000 UTC m=+1100.449338989" watchObservedRunningTime="2026-09-06 10:40:08.674026519 +0000 UTC m=+1100.452445931"
Sep 06 10:40:17.326230 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:17.326198    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:40:18.307210 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:18.307176    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:18.307434 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:18.307225    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:18.319675 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:18.319648    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:18.729087 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:18.729058    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:40:39.200060 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:39.200023    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:40:48.912070 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:48.912037    2561 scope.go:117] "RemoveContainer" containerID="8c821a8e74866fbc8a7a20bd0dafe2a36d1c40fb1038c71e3e404022b55194b9"
Sep 06 10:40:48.921245 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:48.921227    2561 scope.go:117] "RemoveContainer" containerID="b718b745ab0c8f0015af977348b0f0c18579ee24536fd6e8cb941601fa897d8f"
Sep 06 10:40:49.684741 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:49.684713    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:40:49.785602 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:49.785571    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:40:50.172285 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:50.172252    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b21e0db6-j7rlp"]
Sep 06 10:40:50.177147 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:50.177129    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b21e0db6-j7rlp"
Sep 06 10:40:50.179463 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:50.179442    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n5b2f\""
Sep 06 10:40:50.187110 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:50.187083    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b21e0db6-j7rlp"]
Sep 06 10:40:50.255828 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:50.255796    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42cac907-d556-409d-be79-391e6f7253d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b21e0db6-j7rlp\" (UID: \"42cac907-d556-409d-be79-391e6f7253d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b21e0db6-j7rlp"
Sep 06 10:40:50.311677 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:50.311644    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:40:50.356539 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:50.356502    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42cac907-d556-409d-be79-391e6f7253d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b21e0db6-j7rlp\" (UID: \"42cac907-d556-409d-be79-391e6f7253d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b21e0db6-j7rlp"
Sep 06 10:40:50.357111 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:50.357092    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42cac907-d556-409d-be79-391e6f7253d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b21e0db6-j7rlp\" (UID: \"42cac907-d556-409d-be79-391e6f7253d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b21e0db6-j7rlp"
Sep 06 10:40:50.490767 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:50.490675    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b21e0db6-j7rlp"
Sep 06 10:40:50.761182 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:50.761151    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b21e0db6-j7rlp"]
Sep 06 10:40:50.762372 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:40:50.762341    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42cac907_d556_409d_be79_391e6f7253d4.slice/crio-0820a7edc206ee40551fd13201b783068456e03b3864486b0db680a65ade7e41 WatchSource:0}: Error finding container 0820a7edc206ee40551fd13201b783068456e03b3864486b0db680a65ade7e41: Status 404 returned error can't find the container with id 0820a7edc206ee40551fd13201b783068456e03b3864486b0db680a65ade7e41
Sep 06 10:40:50.925581 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:50.925515    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b21e0db6-j7rlp" event={"ID":"42cac907-d556-409d-be79-391e6f7253d4","Type":"ContainerStarted","Data":"0820a7edc206ee40551fd13201b783068456e03b3864486b0db680a65ade7e41"}
Sep 06 10:40:51.933767 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:51.933728    2561 generic.go:356] "Generic (PLEG): container finished" podID="42cac907-d556-409d-be79-391e6f7253d4" containerID="c75262446abe8b5c3c121e9c2dd04f893fa6ff9e62afe3ae3ed09a8d22958718" exitCode=0
Sep 06 10:40:51.934185 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:51.933818    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b21e0db6-j7rlp" event={"ID":"42cac907-d556-409d-be79-391e6f7253d4","Type":"ContainerDied","Data":"c75262446abe8b5c3c121e9c2dd04f893fa6ff9e62afe3ae3ed09a8d22958718"}
Sep 06 10:40:53.077664 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:53.077639    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b21e0db6-j7rlp"
Sep 06 10:40:53.184017 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:53.183983    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42cac907-d556-409d-be79-391e6f7253d4-maas-api-service-ca\") pod \"42cac907-d556-409d-be79-391e6f7253d4\" (UID: \"42cac907-d556-409d-be79-391e6f7253d4\") "
Sep 06 10:40:53.184372 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:53.184351    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42cac907-d556-409d-be79-391e6f7253d4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "42cac907-d556-409d-be79-391e6f7253d4" (UID: "42cac907-d556-409d-be79-391e6f7253d4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:40:53.285078 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:53.284983    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42cac907-d556-409d-be79-391e6f7253d4-maas-api-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:40:53.947748 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:53.947715    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b21e0db6-j7rlp"
Sep 06 10:40:53.947942 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:53.947746    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b21e0db6-j7rlp" event={"ID":"42cac907-d556-409d-be79-391e6f7253d4","Type":"ContainerDied","Data":"0820a7edc206ee40551fd13201b783068456e03b3864486b0db680a65ade7e41"}
Sep 06 10:40:53.947942 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:40:53.947832    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0820a7edc206ee40551fd13201b783068456e03b3864486b0db680a65ade7e41"
Sep 06 10:41:05.646241 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:05.646209    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:41:05.776553 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:05.776517    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:41:05.880783 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:05.880751    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:41:05.980527 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:05.980497    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:41:05.991375 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:05.991342    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b21e0db6-j7rlp"]
Sep 06 10:41:05.995971 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:05.995943    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b21e0db6-j7rlp"]
Sep 06 10:41:06.036242 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:06.036209    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:41:06.754516 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:06.754485    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42cac907-d556-409d-be79-391e6f7253d4" path="/var/lib/kubelet/pods/42cac907-d556-409d-be79-391e6f7253d4/volumes"
Sep 06 10:41:09.095412 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:09.095383    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:41:14.080435 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:14.080346    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"]
Sep 06 10:41:14.126993 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:14.126953    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:41:29.100849 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:29.100790    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv" podUID="922cc6e8-1b28-4833-a9b1-7825293478c8" containerName="main" containerID="cri-o://7ee20271fd487689da9df866ce324883881fe36006886118e9dd8e2368be44c7" gracePeriod=45
Sep 06 10:41:29.352620 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:29.352559    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:41:29.463889 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:29.463850    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/922cc6e8-1b28-4833-a9b1-7825293478c8-tls-certs\") pod \"922cc6e8-1b28-4833-a9b1-7825293478c8\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") "
Sep 06 10:41:29.464049 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:29.463936    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-tmp-dir\") pod \"922cc6e8-1b28-4833-a9b1-7825293478c8\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") "
Sep 06 10:41:29.464049 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:29.464003    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-home\") pod \"922cc6e8-1b28-4833-a9b1-7825293478c8\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") "
Sep 06 10:41:29.464049 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:29.464039    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qcwz\" (UniqueName: \"kubernetes.io/projected/922cc6e8-1b28-4833-a9b1-7825293478c8-kube-api-access-2qcwz\") pod \"922cc6e8-1b28-4833-a9b1-7825293478c8\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") "
Sep 06 10:41:29.464206 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:29.464062    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-dshm\") pod \"922cc6e8-1b28-4833-a9b1-7825293478c8\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") "
Sep 06 10:41:29.464206 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:29.464079    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-model-cache\") pod \"922cc6e8-1b28-4833-a9b1-7825293478c8\" (UID: \"922cc6e8-1b28-4833-a9b1-7825293478c8\") "
Sep 06 10:41:29.464318 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:29.464198    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "922cc6e8-1b28-4833-a9b1-7825293478c8" (UID: "922cc6e8-1b28-4833-a9b1-7825293478c8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:41:29.464424 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:29.464351    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-home" (OuterVolumeSpecName: "home") pod "922cc6e8-1b28-4833-a9b1-7825293478c8" (UID: "922cc6e8-1b28-4833-a9b1-7825293478c8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:41:29.464482 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:29.464444    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-tmp-dir\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:41:29.464482 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:29.464462    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-home\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:41:29.464482 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:29.464458    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-model-cache" (OuterVolumeSpecName: "model-cache") pod "922cc6e8-1b28-4833-a9b1-7825293478c8" (UID: "922cc6e8-1b28-4833-a9b1-7825293478c8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:41:29.466189 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:29.466167    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/922cc6e8-1b28-4833-a9b1-7825293478c8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "922cc6e8-1b28-4833-a9b1-7825293478c8" (UID: "922cc6e8-1b28-4833-a9b1-7825293478c8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 10:41:29.466275 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:29.466213    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-dshm" (OuterVolumeSpecName: "dshm") pod "922cc6e8-1b28-4833-a9b1-7825293478c8" (UID: "922cc6e8-1b28-4833-a9b1-7825293478c8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:41:29.466275 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:29.466222    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/922cc6e8-1b28-4833-a9b1-7825293478c8-kube-api-access-2qcwz" (OuterVolumeSpecName: "kube-api-access-2qcwz") pod "922cc6e8-1b28-4833-a9b1-7825293478c8" (UID: "922cc6e8-1b28-4833-a9b1-7825293478c8"). InnerVolumeSpecName "kube-api-access-2qcwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:41:29.565403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:29.565351    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qcwz\" (UniqueName: \"kubernetes.io/projected/922cc6e8-1b28-4833-a9b1-7825293478c8-kube-api-access-2qcwz\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:41:29.565403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:29.565398    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-dshm\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:41:29.565403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:29.565411    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/922cc6e8-1b28-4833-a9b1-7825293478c8-model-cache\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:41:29.565644 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:29.565424    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/922cc6e8-1b28-4833-a9b1-7825293478c8-tls-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:41:30.188588 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:30.188550    2561 generic.go:356] "Generic (PLEG): container finished" podID="922cc6e8-1b28-4833-a9b1-7825293478c8" containerID="7ee20271fd487689da9df866ce324883881fe36006886118e9dd8e2368be44c7" exitCode=0
Sep 06 10:41:30.189014 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:30.188595    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"
Sep 06 10:41:30.189014 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:30.188631    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv" event={"ID":"922cc6e8-1b28-4833-a9b1-7825293478c8","Type":"ContainerDied","Data":"7ee20271fd487689da9df866ce324883881fe36006886118e9dd8e2368be44c7"}
Sep 06 10:41:30.189014 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:30.188674    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv" event={"ID":"922cc6e8-1b28-4833-a9b1-7825293478c8","Type":"ContainerDied","Data":"72ce66f4844c4e631bc11c758665c24985781e88d425676c55b0bc36daf67dfe"}
Sep 06 10:41:30.189014 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:30.188693    2561 scope.go:117] "RemoveContainer" containerID="7ee20271fd487689da9df866ce324883881fe36006886118e9dd8e2368be44c7"
Sep 06 10:41:30.199275 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:30.199249    2561 scope.go:117] "RemoveContainer" containerID="7ee20271fd487689da9df866ce324883881fe36006886118e9dd8e2368be44c7"
Sep 06 10:41:30.199556 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:41:30.199531    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ee20271fd487689da9df866ce324883881fe36006886118e9dd8e2368be44c7\": container with ID starting with 7ee20271fd487689da9df866ce324883881fe36006886118e9dd8e2368be44c7 not found: ID does not exist" containerID="7ee20271fd487689da9df866ce324883881fe36006886118e9dd8e2368be44c7"
Sep 06 10:41:30.199659 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:30.199563    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ee20271fd487689da9df866ce324883881fe36006886118e9dd8e2368be44c7"} err="failed to get container status \"7ee20271fd487689da9df866ce324883881fe36006886118e9dd8e2368be44c7\": rpc error: code = NotFound desc = could not find container \"7ee20271fd487689da9df866ce324883881fe36006886118e9dd8e2368be44c7\": container with ID starting with 7ee20271fd487689da9df866ce324883881fe36006886118e9dd8e2368be44c7 not found: ID does not exist"
Sep 06 10:41:30.210645 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:30.210617    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"]
Sep 06 10:41:30.216203 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:30.216177    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-b21e0db6/e2e-lifecycle-model-b21e0db6-kserve-666b469887-5f5rv"]
Sep 06 10:41:30.755742 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:30.755706    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="922cc6e8-1b28-4833-a9b1-7825293478c8" path="/var/lib/kubelet/pods/922cc6e8-1b28-4833-a9b1-7825293478c8/volumes"
Sep 06 10:41:48.789450 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:48.789417    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/1.log"
Sep 06 10:41:48.791089 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:48.791060    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/1.log"
Sep 06 10:41:48.794258 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:48.794235    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsw6t_a4733769-37b3-443b-9ee5-d93bd5f167f0/ovn-acl-logging/0.log"
Sep 06 10:41:48.795775 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:48.795746    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsw6t_a4733769-37b3-443b-9ee5-d93bd5f167f0/ovn-acl-logging/0.log"
Sep 06 10:41:48.948720 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:48.948677    2561 scope.go:117] "RemoveContainer" containerID="7c07b4e92a318ce02604d7d4a0cac082172edabc69ec7d18cf86afba99aca9b3"
Sep 06 10:41:48.960390 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:48.960366    2561 scope.go:117] "RemoveContainer" containerID="7ccdccdb6a83691dd24f1b4cc04a098b206e8dcdb2d8411d03dce70f5c25f8d0"
Sep 06 10:41:50.939265 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:50.939230    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:41:51.497722 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:51.497691    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:41:57.101086 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:57.101050    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:41:57.201812 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:57.201777    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:41:57.362973 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:57.362875    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"]
Sep 06 10:41:57.363182 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:57.363156    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn" podUID="f39ce5ea-dd28-4857-a433-613a79dcef71" containerName="istio-proxy" containerID="cri-o://c9b279c3922f532ebfcad9543baad1ee20ddfb73f0f90e8d63d3c5c100459b77" gracePeriod=30
Sep 06 10:41:57.379578 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:57.379549    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:41:58.627684 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:58.627642    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:41:58.727228 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:58.727194    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:41:58.827626 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:58.827594    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:41:59.444974 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:59.444943    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:41:59.535153 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:59.535121    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:41:59.637525 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:41:59.637490    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:00.873511 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:00.873476    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:02.630899 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.630836    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:42:02.802207 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.802169    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-data\") pod \"f39ce5ea-dd28-4857-a433-613a79dcef71\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") "
Sep 06 10:42:02.802207 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.802210    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-workload-certs\") pod \"f39ce5ea-dd28-4857-a433-613a79dcef71\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") "
Sep 06 10:42:02.802508 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.802301    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-podinfo\") pod \"f39ce5ea-dd28-4857-a433-613a79dcef71\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") "
Sep 06 10:42:02.802508 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.802348    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f39ce5ea-dd28-4857-a433-613a79dcef71-istiod-ca-cert\") pod \"f39ce5ea-dd28-4857-a433-613a79dcef71\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") "
Sep 06 10:42:02.802508 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.802389    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-token\") pod \"f39ce5ea-dd28-4857-a433-613a79dcef71\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") "
Sep 06 10:42:02.802508 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.802420    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-envoy\") pod \"f39ce5ea-dd28-4857-a433-613a79dcef71\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") "
Sep 06 10:42:02.802508 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.802486    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-credential-socket\") pod \"f39ce5ea-dd28-4857-a433-613a79dcef71\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") "
Sep 06 10:42:02.802776 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.802513    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-workload-socket\") pod \"f39ce5ea-dd28-4857-a433-613a79dcef71\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") "
Sep 06 10:42:02.802776 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.802542    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-data" (OuterVolumeSpecName: "istio-data") pod "f39ce5ea-dd28-4857-a433-613a79dcef71" (UID: "f39ce5ea-dd28-4857-a433-613a79dcef71"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:42:02.802776 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.802547    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqxxc\" (UniqueName: \"kubernetes.io/projected/f39ce5ea-dd28-4857-a433-613a79dcef71-kube-api-access-cqxxc\") pod \"f39ce5ea-dd28-4857-a433-613a79dcef71\" (UID: \"f39ce5ea-dd28-4857-a433-613a79dcef71\") "
Sep 06 10:42:02.802776 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.802559    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f39ce5ea-dd28-4857-a433-613a79dcef71" (UID: "f39ce5ea-dd28-4857-a433-613a79dcef71"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:42:02.802996 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.802817    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f39ce5ea-dd28-4857-a433-613a79dcef71" (UID: "f39ce5ea-dd28-4857-a433-613a79dcef71"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:42:02.802996 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.802830    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f39ce5ea-dd28-4857-a433-613a79dcef71" (UID: "f39ce5ea-dd28-4857-a433-613a79dcef71"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:42:02.802996 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.802850    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f39ce5ea-dd28-4857-a433-613a79dcef71-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f39ce5ea-dd28-4857-a433-613a79dcef71" (UID: "f39ce5ea-dd28-4857-a433-613a79dcef71"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:42:02.803167 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.803032    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:42:02.803167 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.803053    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:42:02.803167 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.803067    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f39ce5ea-dd28-4857-a433-613a79dcef71-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:42:02.803167 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.803079    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:42:02.803167 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.803094    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:42:02.804641 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.804607    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f39ce5ea-dd28-4857-a433-613a79dcef71" (UID: "f39ce5ea-dd28-4857-a433-613a79dcef71"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:42:02.804760 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.804665    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f39ce5ea-dd28-4857-a433-613a79dcef71" (UID: "f39ce5ea-dd28-4857-a433-613a79dcef71"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 10:42:02.804760 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.804703    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f39ce5ea-dd28-4857-a433-613a79dcef71-kube-api-access-cqxxc" (OuterVolumeSpecName: "kube-api-access-cqxxc") pod "f39ce5ea-dd28-4857-a433-613a79dcef71" (UID: "f39ce5ea-dd28-4857-a433-613a79dcef71"). InnerVolumeSpecName "kube-api-access-cqxxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:42:02.804760 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.804708    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-token" (OuterVolumeSpecName: "istio-token") pod "f39ce5ea-dd28-4857-a433-613a79dcef71" (UID: "f39ce5ea-dd28-4857-a433-613a79dcef71"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:42:02.904619 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.904584    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqxxc\" (UniqueName: \"kubernetes.io/projected/f39ce5ea-dd28-4857-a433-613a79dcef71-kube-api-access-cqxxc\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:42:02.904619 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.904619    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:42:02.904812 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.904632    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:42:02.904812 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:02.904644    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f39ce5ea-dd28-4857-a433-613a79dcef71-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:42:03.403387 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:03.403283    2561 generic.go:356] "Generic (PLEG): container finished" podID="f39ce5ea-dd28-4857-a433-613a79dcef71" containerID="c9b279c3922f532ebfcad9543baad1ee20ddfb73f0f90e8d63d3c5c100459b77" exitCode=0
Sep 06 10:42:03.403387 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:03.403343    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"
Sep 06 10:42:03.403387 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:03.403369    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn" event={"ID":"f39ce5ea-dd28-4857-a433-613a79dcef71","Type":"ContainerDied","Data":"c9b279c3922f532ebfcad9543baad1ee20ddfb73f0f90e8d63d3c5c100459b77"}
Sep 06 10:42:03.403611 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:03.403425    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn" event={"ID":"f39ce5ea-dd28-4857-a433-613a79dcef71","Type":"ContainerDied","Data":"08cc9eb00c5e5edebf35060353014b43c87e3125d6d78629d3b9e9b2f5bd5bf8"}
Sep 06 10:42:03.403611 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:03.403449    2561 scope.go:117] "RemoveContainer" containerID="c9b279c3922f532ebfcad9543baad1ee20ddfb73f0f90e8d63d3c5c100459b77"
Sep 06 10:42:03.414159 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:03.414146    2561 scope.go:117] "RemoveContainer" containerID="988438d012de35e4f58cf908d59897a26d5f1fd6850995bbc4f4c664c8fbe912"
Sep 06 10:42:03.422553 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:03.422534    2561 scope.go:117] "RemoveContainer" containerID="c9b279c3922f532ebfcad9543baad1ee20ddfb73f0f90e8d63d3c5c100459b77"
Sep 06 10:42:03.422812 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:42:03.422793    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9b279c3922f532ebfcad9543baad1ee20ddfb73f0f90e8d63d3c5c100459b77\": container with ID starting with c9b279c3922f532ebfcad9543baad1ee20ddfb73f0f90e8d63d3c5c100459b77 not found: ID does not exist" containerID="c9b279c3922f532ebfcad9543baad1ee20ddfb73f0f90e8d63d3c5c100459b77"
Sep 06 10:42:03.422884 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:03.422826    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b279c3922f532ebfcad9543baad1ee20ddfb73f0f90e8d63d3c5c100459b77"} err="failed to get container status \"c9b279c3922f532ebfcad9543baad1ee20ddfb73f0f90e8d63d3c5c100459b77\": rpc error: code = NotFound desc = could not find container \"c9b279c3922f532ebfcad9543baad1ee20ddfb73f0f90e8d63d3c5c100459b77\": container with ID starting with c9b279c3922f532ebfcad9543baad1ee20ddfb73f0f90e8d63d3c5c100459b77 not found: ID does not exist"
Sep 06 10:42:03.422884 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:03.422850    2561 scope.go:117] "RemoveContainer" containerID="988438d012de35e4f58cf908d59897a26d5f1fd6850995bbc4f4c664c8fbe912"
Sep 06 10:42:03.423146 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:42:03.423125    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"988438d012de35e4f58cf908d59897a26d5f1fd6850995bbc4f4c664c8fbe912\": container with ID starting with 988438d012de35e4f58cf908d59897a26d5f1fd6850995bbc4f4c664c8fbe912 not found: ID does not exist" containerID="988438d012de35e4f58cf908d59897a26d5f1fd6850995bbc4f4c664c8fbe912"
Sep 06 10:42:03.423247 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:03.423152    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"988438d012de35e4f58cf908d59897a26d5f1fd6850995bbc4f4c664c8fbe912"} err="failed to get container status \"988438d012de35e4f58cf908d59897a26d5f1fd6850995bbc4f4c664c8fbe912\": rpc error: code = NotFound desc = could not find container \"988438d012de35e4f58cf908d59897a26d5f1fd6850995bbc4f4c664c8fbe912\": container with ID starting with 988438d012de35e4f58cf908d59897a26d5f1fd6850995bbc4f4c664c8fbe912 not found: ID does not exist"
Sep 06 10:42:03.426643 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:03.426622    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"]
Sep 06 10:42:03.430165 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:03.430144    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b21e0db6-openshift-default-57889c4d56-r2dsn"]
Sep 06 10:42:04.754673 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:04.754642    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f39ce5ea-dd28-4857-a433-613a79dcef71" path="/var/lib/kubelet/pods/f39ce5ea-dd28-4857-a433-613a79dcef71/volumes"
Sep 06 10:42:06.716364 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:06.716309    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:06.819717 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:06.819685    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:07.402745 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:07.402703    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:13.293091 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:13.293054    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:13.353403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:13.353369    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:13.494069 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:13.494028    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:13.623800 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:13.623700    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:24.022719 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:24.022687    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:24.250335 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:24.250301    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:37.483958 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:37.483920    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7840-f4f6c3"]
Sep 06 10:42:37.484607 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:37.484582    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f39ce5ea-dd28-4857-a433-613a79dcef71" containerName="istio-proxy"
Sep 06 10:42:37.484690 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:37.484611    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f39ce5ea-dd28-4857-a433-613a79dcef71" containerName="istio-proxy"
Sep 06 10:42:37.484690 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:37.484637    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42cac907-d556-409d-be79-391e6f7253d4" containerName="revoke-keys"
Sep 06 10:42:37.484690 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:37.484646    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="42cac907-d556-409d-be79-391e6f7253d4" containerName="revoke-keys"
Sep 06 10:42:37.484690 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:37.484664    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922cc6e8-1b28-4833-a9b1-7825293478c8" containerName="main"
Sep 06 10:42:37.484690 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:37.484672    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="922cc6e8-1b28-4833-a9b1-7825293478c8" containerName="main"
Sep 06 10:42:37.484947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:37.484766    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f39ce5ea-dd28-4857-a433-613a79dcef71" containerName="istio-proxy"
Sep 06 10:42:37.484947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:37.484780    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="922cc6e8-1b28-4833-a9b1-7825293478c8" containerName="main"
Sep 06 10:42:37.484947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:37.484790    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f39ce5ea-dd28-4857-a433-613a79dcef71" containerName="istio-proxy"
Sep 06 10:42:37.484947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:37.484802    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="42cac907-d556-409d-be79-391e6f7253d4" containerName="revoke-keys"
Sep 06 10:42:37.488162 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:37.488141    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7840-f4f6c3"
Sep 06 10:42:37.491908 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:37.491877    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-728g6\""
Sep 06 10:42:37.494026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:37.494000    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7840-f4f6c3"]
Sep 06 10:42:37.630508 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:37.630473    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dd2q\" (UniqueName: \"kubernetes.io/projected/38d0bb13-fb1d-4112-bf24-3b338c29523b-kube-api-access-4dd2q\") pod \"mt-curl-7840-f4f6c3\" (UID: \"38d0bb13-fb1d-4112-bf24-3b338c29523b\") " pod="opendatahub/mt-curl-7840-f4f6c3"
Sep 06 10:42:37.732100 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:37.732068    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dd2q\" (UniqueName: \"kubernetes.io/projected/38d0bb13-fb1d-4112-bf24-3b338c29523b-kube-api-access-4dd2q\") pod \"mt-curl-7840-f4f6c3\" (UID: \"38d0bb13-fb1d-4112-bf24-3b338c29523b\") " pod="opendatahub/mt-curl-7840-f4f6c3"
Sep 06 10:42:37.739686 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:37.739615    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dd2q\" (UniqueName: \"kubernetes.io/projected/38d0bb13-fb1d-4112-bf24-3b338c29523b-kube-api-access-4dd2q\") pod \"mt-curl-7840-f4f6c3\" (UID: \"38d0bb13-fb1d-4112-bf24-3b338c29523b\") " pod="opendatahub/mt-curl-7840-f4f6c3"
Sep 06 10:42:37.801562 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:37.801530    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7840-f4f6c3"
Sep 06 10:42:38.086146 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:38.086116    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7840-f4f6c3"]
Sep 06 10:42:38.087447 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:42:38.087419    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38d0bb13_fb1d_4112_bf24_3b338c29523b.slice/crio-951ea1f1bde95b9d4205471a9b0173cd0dd421fd7c5a972cb6f732e2fb7bdb91 WatchSource:0}: Error finding container 951ea1f1bde95b9d4205471a9b0173cd0dd421fd7c5a972cb6f732e2fb7bdb91: Status 404 returned error can't find the container with id 951ea1f1bde95b9d4205471a9b0173cd0dd421fd7c5a972cb6f732e2fb7bdb91
Sep 06 10:42:38.617241 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:38.617206    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7840-f4f6c3" event={"ID":"38d0bb13-fb1d-4112-bf24-3b338c29523b","Type":"ContainerStarted","Data":"951ea1f1bde95b9d4205471a9b0173cd0dd421fd7c5a972cb6f732e2fb7bdb91"}
Sep 06 10:42:39.625944 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:39.625903    2561 generic.go:356] "Generic (PLEG): container finished" podID="38d0bb13-fb1d-4112-bf24-3b338c29523b" containerID="e8694d8ea38d9f3f06988647c4039ceb523c95f0a9f6604e7563e72b696cccdd" exitCode=0
Sep 06 10:42:39.626357 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:39.625996    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7840-f4f6c3" event={"ID":"38d0bb13-fb1d-4112-bf24-3b338c29523b","Type":"ContainerDied","Data":"e8694d8ea38d9f3f06988647c4039ceb523c95f0a9f6604e7563e72b696cccdd"}
Sep 06 10:42:40.775733 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:40.775704    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7840-f4f6c3"
Sep 06 10:42:40.793513 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:40.793480    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7840-f4f6c3_38d0bb13-fb1d-4112-bf24-3b338c29523b/mt-curl-7840-f4f6c3/0.log"
Sep 06 10:42:40.814796 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:40.814761    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7840-f4f6c3"]
Sep 06 10:42:40.817349 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:40.817309    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7840-f4f6c3"]
Sep 06 10:42:40.863402 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:40.863376    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dd2q\" (UniqueName: \"kubernetes.io/projected/38d0bb13-fb1d-4112-bf24-3b338c29523b-kube-api-access-4dd2q\") pod \"38d0bb13-fb1d-4112-bf24-3b338c29523b\" (UID: \"38d0bb13-fb1d-4112-bf24-3b338c29523b\") "
Sep 06 10:42:40.865509 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:40.865484    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38d0bb13-fb1d-4112-bf24-3b338c29523b-kube-api-access-4dd2q" (OuterVolumeSpecName: "kube-api-access-4dd2q") pod "38d0bb13-fb1d-4112-bf24-3b338c29523b" (UID: "38d0bb13-fb1d-4112-bf24-3b338c29523b"). InnerVolumeSpecName "kube-api-access-4dd2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:42:40.965104 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:40.965032    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dd2q\" (UniqueName: \"kubernetes.io/projected/38d0bb13-fb1d-4112-bf24-3b338c29523b-kube-api-access-4dd2q\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:42:41.639783 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:41.639744    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7840-f4f6c3"
Sep 06 10:42:41.639783 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:41.639784    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="951ea1f1bde95b9d4205471a9b0173cd0dd421fd7c5a972cb6f732e2fb7bdb91"
Sep 06 10:42:41.649256 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:42:41.649229    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7840-f4f6c3\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="38d0bb13-fb1d-4112-bf24-3b338c29523b" pod="opendatahub/mt-curl-7840-f4f6c3"
Sep 06 10:42:42.177468 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:42.177434    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:42.754686 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:42.754653    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38d0bb13-fb1d-4112-bf24-3b338c29523b" path="/var/lib/kubelet/pods/38d0bb13-fb1d-4112-bf24-3b338c29523b/volumes"
Sep 06 10:42:43.131255 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:43.131172    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:45.160439 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:45.160402    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:49.012046 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:49.012014    2561 scope.go:117] "RemoveContainer" containerID="9173385629dfb036dcb7e3a9196bae80297ee697cf26093b12919cb0f74d2c6d"
Sep 06 10:42:50.770576 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:50.770539    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:50.868391 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:50.868347    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:51.129547 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.129468    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:51.465845 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.465813    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"]
Sep 06 10:42:51.466428 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.466398    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f39ce5ea-dd28-4857-a433-613a79dcef71" containerName="istio-proxy"
Sep 06 10:42:51.466428 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.466424    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f39ce5ea-dd28-4857-a433-613a79dcef71" containerName="istio-proxy"
Sep 06 10:42:51.466577 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.466439    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38d0bb13-fb1d-4112-bf24-3b338c29523b" containerName="mt-curl-7840-f4f6c3"
Sep 06 10:42:51.466577 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.466448    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="38d0bb13-fb1d-4112-bf24-3b338c29523b" containerName="mt-curl-7840-f4f6c3"
Sep 06 10:42:51.466577 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.466534    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="38d0bb13-fb1d-4112-bf24-3b338c29523b" containerName="mt-curl-7840-f4f6c3"
Sep 06 10:42:51.470974 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.470942    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.473476 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.473455    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-616a10-openshift-default-dockercfg-t7nhv\""
Sep 06 10:42:51.483288 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.483260    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"]
Sep 06 10:42:51.493004 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.492982    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:51.567499 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.567456    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-envoy\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.567690 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.567516    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-workload-certs\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.567690 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.567582    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-data\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.567690 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.567656    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-credential-socket\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.567883 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.567702    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-podinfo\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.567883 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.567827    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-workload-socket\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.567883 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.567861    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-token\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.568054 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.567894    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzjjm\" (UniqueName: \"kubernetes.io/projected/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-kube-api-access-kzjjm\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.568054 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.567953    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istiod-ca-cert\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.668714 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.668678    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-workload-socket\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.668714 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.668719    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-token\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.668955 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.668738    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzjjm\" (UniqueName: \"kubernetes.io/projected/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-kube-api-access-kzjjm\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.668955 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.668778    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istiod-ca-cert\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.668955 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.668812    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-envoy\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.668955 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.668846    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-workload-certs\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.668955 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.668876    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-data\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.668955 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.668910    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-credential-socket\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.668955 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.668936    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-podinfo\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.669355 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.669142    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-workload-socket\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.669355 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.669207    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-workload-certs\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.669485 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.669376    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-data\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.669485 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.669450    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-credential-socket\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.669664 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.669641    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istiod-ca-cert\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.670966 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.670947    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-envoy\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.671314 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.671299    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-podinfo\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.677892 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.677869    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-token\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.678092 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.678067    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzjjm\" (UniqueName: \"kubernetes.io/projected/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-kube-api-access-kzjjm\") pod \"e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") " pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:51.782515 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:51.782443    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:52.054958 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:52.054929    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"]
Sep 06 10:42:52.056087 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:42:52.056059    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41626d02_ed3a_4ecb_b65c_754d1e81b2cc.slice/crio-a3b4ae7cbbebeb9c1bba5dbf56dfc49c99b03d4b4e2f1d535b66bc519cfc1e7f WatchSource:0}: Error finding container a3b4ae7cbbebeb9c1bba5dbf56dfc49c99b03d4b4e2f1d535b66bc519cfc1e7f: Status 404 returned error can't find the container with id a3b4ae7cbbebeb9c1bba5dbf56dfc49c99b03d4b4e2f1d535b66bc519cfc1e7f
Sep 06 10:42:52.058450 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:52.058418    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:42:52.058519 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:52.058482    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:42:52.058519 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:52.058511    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:42:52.190312 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:52.190278    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:52.710744 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:52.710706    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2" event={"ID":"41626d02-ed3a-4ecb-b65c-754d1e81b2cc","Type":"ContainerStarted","Data":"8d9c4081ba7b57cbf4b8310316268a1491360bb9d9ceebe3e4eda62128b705c2"}
Sep 06 10:42:52.710918 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:52.710761    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2" event={"ID":"41626d02-ed3a-4ecb-b65c-754d1e81b2cc","Type":"ContainerStarted","Data":"a3b4ae7cbbebeb9c1bba5dbf56dfc49c99b03d4b4e2f1d535b66bc519cfc1e7f"}
Sep 06 10:42:52.732404 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:52.732356    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2" podStartSLOduration=1.73234077 podStartE2EDuration="1.73234077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:42:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:42:52.730442541 +0000 UTC m=+1264.508861980" watchObservedRunningTime="2026-09-06 10:42:52.73234077 +0000 UTC m=+1264.510760174"
Sep 06 10:42:52.782945 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:52.782916    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:53.788161 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:53.788132    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:54.637089 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:54.637054    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:54.723778 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:54.723732    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:54.724753 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:54.724731    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:42:54.736725 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:54.736695    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:55.807679 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:55.807643    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:42:56.983992 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:42:56.983963    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:09.816558 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:09.816510    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:10.766499 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:10.766457    2561 patch_prober.go:28] interesting pod/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 10:43:10.766686 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:10.766537    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2" podUID="41626d02-ed3a-4ecb-b65c-754d1e81b2cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 10:43:12.843680 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:12.843648    2561 generic.go:356] "Generic (PLEG): container finished" podID="41626d02-ed3a-4ecb-b65c-754d1e81b2cc" containerID="8d9c4081ba7b57cbf4b8310316268a1491360bb9d9ceebe3e4eda62128b705c2" exitCode=0
Sep 06 10:43:12.844115 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:12.843727    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2" event={"ID":"41626d02-ed3a-4ecb-b65c-754d1e81b2cc","Type":"ContainerDied","Data":"8d9c4081ba7b57cbf4b8310316268a1491360bb9d9ceebe3e4eda62128b705c2"}
Sep 06 10:43:12.844168 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:12.844152    2561 scope.go:117] "RemoveContainer" containerID="8d9c4081ba7b57cbf4b8310316268a1491360bb9d9ceebe3e4eda62128b705c2"
Sep 06 10:43:12.845405 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:12.845372    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:43:12.845477 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:12.845443    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:43:12.845514 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:12.845497    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:43:13.857850 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:13.857802    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2" event={"ID":"41626d02-ed3a-4ecb-b65c-754d1e81b2cc","Type":"ContainerStarted","Data":"4b16ebcb48a6267009dec682b0263e7b29fb6a341f49c17059958bf41a1e60ce"}
Sep 06 10:43:14.783240 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:14.783206    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:43:14.783446 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:14.783402    2561 patch_prober.go:28] interesting pod/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 06 10:43:14.783497 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:14.783449    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2" podUID="41626d02-ed3a-4ecb-b65c-754d1e81b2cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 06 10:43:15.783904 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:15.783862    2561 patch_prober.go:28] interesting pod/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 06 10:43:15.784291 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:15.783932    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2" podUID="41626d02-ed3a-4ecb-b65c-754d1e81b2cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 06 10:43:16.783105 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:16.783073    2561 patch_prober.go:28] interesting pod/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 06 10:43:16.783273 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:16.783120    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2" podUID="41626d02-ed3a-4ecb-b65c-754d1e81b2cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 06 10:43:17.783627 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:17.783592    2561 patch_prober.go:28] interesting pod/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 06 10:43:17.784001 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:17.783647    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2" podUID="41626d02-ed3a-4ecb-b65c-754d1e81b2cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 06 10:43:18.991972 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:18.991938    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:43:18.992488 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:18.992333    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:43:18.993114 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:18.993098    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:43:19.674693 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:19.674661    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:20.143086 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.142996    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:20.439621 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.439589    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"]
Sep 06 10:43:20.446194 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.444612    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.450298 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.450270    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-40f309-openshift-default-dockercfg-jvrpf\""
Sep 06 10:43:20.465276 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.465252    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"]
Sep 06 10:43:20.490216 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.490183    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:20.554800 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.554762    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-workload-socket\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.554800 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.554801    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-workload-certs\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.555051 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.554824    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-envoy\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.555051 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.554840    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-data\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.555051 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.554961    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-token\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.555215 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.555048    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bsk8\" (UniqueName: \"kubernetes.io/projected/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-kube-api-access-7bsk8\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.555215 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.555105    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-credential-socket\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.555215 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.555150    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-podinfo\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.555215 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.555175    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istiod-ca-cert\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.585299 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.585271    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:20.656074 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.656033    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bsk8\" (UniqueName: \"kubernetes.io/projected/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-kube-api-access-7bsk8\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.656297 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.656098    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-credential-socket\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.656297 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.656153    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-podinfo\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.656297 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.656213    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istiod-ca-cert\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.656516 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.656348    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-workload-socket\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.656516 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.656386    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-workload-certs\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.656516 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.656424    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-envoy\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.656516 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.656450    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-data\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.656724 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.656539    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-token\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.656781 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.656762    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-workload-certs\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.656993 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.656967    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-credential-socket\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.657097 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.657027    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istiod-ca-cert\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.657157 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.657101    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-data\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.657214 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.657171    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-workload-socket\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.658925 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.658906    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-envoy\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.659360 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.659340    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-podinfo\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.666085 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.666065    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-token\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.666695 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.666671    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bsk8\" (UniqueName: \"kubernetes.io/projected/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-kube-api-access-7bsk8\") pod \"e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") " pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:20.760607 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:20.760527    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:21.042028 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:21.041997    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"]
Sep 06 10:43:21.043669 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:43:21.043644    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda127ba01_e8c1_4e52_86b4_d8d3c1ab8302.slice/crio-864d11ac804e86d423639e29692e7b82eaf90c8c32e063a26f187b3a4f7a1775 WatchSource:0}: Error finding container 864d11ac804e86d423639e29692e7b82eaf90c8c32e063a26f187b3a4f7a1775: Status 404 returned error can't find the container with id 864d11ac804e86d423639e29692e7b82eaf90c8c32e063a26f187b3a4f7a1775
Sep 06 10:43:21.046229 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:21.046198    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:43:21.046306 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:21.046264    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:43:21.046306 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:21.046292    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:43:21.911416 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:21.911372    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh" event={"ID":"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302","Type":"ContainerStarted","Data":"0dc0dcb20f9514c9bea75717e882a6b158eff7851928da92d082c1e8b0db67ae"}
Sep 06 10:43:21.911811 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:21.911434    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh" event={"ID":"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302","Type":"ContainerStarted","Data":"864d11ac804e86d423639e29692e7b82eaf90c8c32e063a26f187b3a4f7a1775"}
Sep 06 10:43:21.932703 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:21.932653    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh" podStartSLOduration=1.932636837 podStartE2EDuration="1.932636837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:43:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:43:21.931316856 +0000 UTC m=+1293.709736269" watchObservedRunningTime="2026-09-06 10:43:21.932636837 +0000 UTC m=+1293.711056251"
Sep 06 10:43:22.761103 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:22.761073    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:22.766541 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:22.766514    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:22.917929 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:22.917900    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:22.918730 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:22.918710    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:23.849716 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:23.849684    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:23.950249 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:23.950219    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:25.114267 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:25.114217    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:25.214274 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:25.214241    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:25.533301 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:25.533270    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:25.757029 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:25.756996    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:25.852778 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:25.852698    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:31.599668 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:31.599635    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:41.118580 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:41.118519    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:43.048388 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:43.048253    2561 generic.go:356] "Generic (PLEG): container finished" podID="a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" containerID="0dc0dcb20f9514c9bea75717e882a6b158eff7851928da92d082c1e8b0db67ae" exitCode=0
Sep 06 10:43:43.048388 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:43.048356    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh" event={"ID":"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302","Type":"ContainerDied","Data":"0dc0dcb20f9514c9bea75717e882a6b158eff7851928da92d082c1e8b0db67ae"}
Sep 06 10:43:43.048966 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:43.048947    2561 scope.go:117] "RemoveContainer" containerID="0dc0dcb20f9514c9bea75717e882a6b158eff7851928da92d082c1e8b0db67ae"
Sep 06 10:43:43.050209 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:43.050181    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:43:43.050303 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:43.050244    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:43:43.050303 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:43.050282    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:43:44.061997 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:44.061959    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh" event={"ID":"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302","Type":"ContainerStarted","Data":"f9d7b00026ae129cc67d1bc47ece2a397fa16764c053113408b113000600a822"}
Sep 06 10:43:44.760801 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:44.760761    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:44.760996 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:44.760956    2561 patch_prober.go:28] interesting pod/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 06 10:43:44.761070 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:44.761007    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh" podUID="a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 06 10:43:45.761796 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:45.761754    2561 patch_prober.go:28] interesting pod/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 06 10:43:45.762171 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:45.761827    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh" podUID="a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 06 10:43:46.140761 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:46.140654    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:46.761031 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:46.760988    2561 patch_prober.go:28] interesting pod/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 06 10:43:46.761227 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:46.761054    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh" podUID="a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 06 10:43:47.761056 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:47.761014    2561 patch_prober.go:28] interesting pod/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 06 10:43:47.761470 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:47.761076    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh" podUID="a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 06 10:43:48.713299 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:48.713264    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:48.761157 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:48.761122    2561 patch_prober.go:28] interesting pod/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused" start-of-body=
Sep 06 10:43:48.761649 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:48.761183    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh" podUID="a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.84:15021/healthz/ready\": dial tcp 10.133.0.84:15021: connect: connection refused"
Sep 06 10:43:48.848465 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:48.848362    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:49.042528 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:49.042433    2561 scope.go:117] "RemoveContainer" containerID="ed5da1f7023f9df07ce1346104d4810fb91ecc1e8d6b3e53c38f926d9096e77b"
Sep 06 10:43:49.051693 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:49.051669    2561 scope.go:117] "RemoveContainer" containerID="afffcf02e45148d35521a678c0c430eaa4266546c9f80401856e2627ba64ca73"
Sep 06 10:43:49.764851 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:49.764823    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:49.765273 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:49.765251    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:49.765819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:49.765801    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:43:51.810005 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:51.809970    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-616a10-s85dc"]
Sep 06 10:43:51.814687 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:51.814669    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-616a10-s85dc"
Sep 06 10:43:51.818478 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:51.817398    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n5b2f\""
Sep 06 10:43:51.820660 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:51.820622    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-616a10-s85dc"]
Sep 06 10:43:51.876654 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:51.876623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/005173d9-f44e-459f-8216-0c1c8f4dd95b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-616a10-s85dc\" (UID: \"005173d9-f44e-459f-8216-0c1c8f4dd95b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-616a10-s85dc"
Sep 06 10:43:51.912045 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:51.912015    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:51.977409 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:51.977373    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/005173d9-f44e-459f-8216-0c1c8f4dd95b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-616a10-s85dc\" (UID: \"005173d9-f44e-459f-8216-0c1c8f4dd95b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-616a10-s85dc"
Sep 06 10:43:51.978196 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:51.978171    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/005173d9-f44e-459f-8216-0c1c8f4dd95b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-616a10-s85dc\" (UID: \"005173d9-f44e-459f-8216-0c1c8f4dd95b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-616a10-s85dc"
Sep 06 10:43:52.128614 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:52.128523    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-616a10-s85dc"
Sep 06 10:43:52.399666 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:52.399639    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-616a10-s85dc"]
Sep 06 10:43:52.400807 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:43:52.400773    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod005173d9_f44e_459f_8216_0c1c8f4dd95b.slice/crio-593e59b54468f4e59bf9accb1b4cc27832f34e17765155dcd5db706fa2f66abc WatchSource:0}: Error finding container 593e59b54468f4e59bf9accb1b4cc27832f34e17765155dcd5db706fa2f66abc: Status 404 returned error can't find the container with id 593e59b54468f4e59bf9accb1b4cc27832f34e17765155dcd5db706fa2f66abc
Sep 06 10:43:52.432852 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:52.432825    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:52.492888 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:52.492858    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:43:53.117212 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:53.117174    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-616a10-s85dc" event={"ID":"005173d9-f44e-459f-8216-0c1c8f4dd95b","Type":"ContainerStarted","Data":"1d2c856a08612b4f9aa1c039d0c9b0a28f9fce9a084f66ee959b5babb9bacdb2"}
Sep 06 10:43:53.117611 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:53.117235    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-616a10-s85dc" event={"ID":"005173d9-f44e-459f-8216-0c1c8f4dd95b","Type":"ContainerStarted","Data":"593e59b54468f4e59bf9accb1b4cc27832f34e17765155dcd5db706fa2f66abc"}
Sep 06 10:43:53.133070 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:53.133024    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-616a10-s85dc" podStartSLOduration=2.133008654 podStartE2EDuration="2.133008654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:43:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:43:53.131264867 +0000 UTC m=+1324.909684280" watchObservedRunningTime="2026-09-06 10:43:53.133008654 +0000 UTC m=+1324.911428067"
Sep 06 10:43:54.128594 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:54.128548    2561 generic.go:356] "Generic (PLEG): container finished" podID="005173d9-f44e-459f-8216-0c1c8f4dd95b" containerID="1d2c856a08612b4f9aa1c039d0c9b0a28f9fce9a084f66ee959b5babb9bacdb2" exitCode=0
Sep 06 10:43:54.129033 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:54.128708    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-616a10-s85dc" event={"ID":"005173d9-f44e-459f-8216-0c1c8f4dd95b","Type":"ContainerDied","Data":"1d2c856a08612b4f9aa1c039d0c9b0a28f9fce9a084f66ee959b5babb9bacdb2"}
Sep 06 10:43:55.268900 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:55.268876    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-616a10-s85dc"
Sep 06 10:43:55.409139 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:55.409116    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/005173d9-f44e-459f-8216-0c1c8f4dd95b-maas-api-service-ca\") pod \"005173d9-f44e-459f-8216-0c1c8f4dd95b\" (UID: \"005173d9-f44e-459f-8216-0c1c8f4dd95b\") "
Sep 06 10:43:55.409539 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:55.409511    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/005173d9-f44e-459f-8216-0c1c8f4dd95b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "005173d9-f44e-459f-8216-0c1c8f4dd95b" (UID: "005173d9-f44e-459f-8216-0c1c8f4dd95b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:43:55.510249 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:55.510220    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/005173d9-f44e-459f-8216-0c1c8f4dd95b-maas-api-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:43:56.143368 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:56.143316    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-616a10-s85dc"
Sep 06 10:43:56.143368 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:56.143354    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-616a10-s85dc" event={"ID":"005173d9-f44e-459f-8216-0c1c8f4dd95b","Type":"ContainerDied","Data":"593e59b54468f4e59bf9accb1b4cc27832f34e17765155dcd5db706fa2f66abc"}
Sep 06 10:43:56.143625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:43:56.143400    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="593e59b54468f4e59bf9accb1b4cc27832f34e17765155dcd5db706fa2f66abc"
Sep 06 10:44:07.336090 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:07.336052    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:07.401775 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:07.401743    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:07.460861 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:07.460827    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:07.533639 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:07.533606    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-616a10-s85dc"]
Sep 06 10:44:07.535042 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:07.535000    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:07.536600 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:07.536577    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-616a10-s85dc"]
Sep 06 10:44:07.603408 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:07.603308    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:07.886281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:07.886173    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:08.754316 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:08.754285    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="005173d9-f44e-459f-8216-0c1c8f4dd95b" path="/var/lib/kubelet/pods/005173d9-f44e-459f-8216-0c1c8f4dd95b/volumes"
Sep 06 10:44:10.505813 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:10.505764    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:13.718127 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:13.718029    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:13.818131 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:13.818094    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:13.943438 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:13.943402    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"]
Sep 06 10:44:13.943923 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:13.943890    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2" podUID="41626d02-ed3a-4ecb-b65c-754d1e81b2cc" containerName="istio-proxy" containerID="cri-o://4b16ebcb48a6267009dec682b0263e7b29fb6a341f49c17059958bf41a1e60ce" gracePeriod=30
Sep 06 10:44:13.968000 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:13.967957    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:14.293309 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:14.293272    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-40f309-mbk7k"]
Sep 06 10:44:14.293755 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:14.293740    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="005173d9-f44e-459f-8216-0c1c8f4dd95b" containerName="revoke-keys"
Sep 06 10:44:14.293804 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:14.293757    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="005173d9-f44e-459f-8216-0c1c8f4dd95b" containerName="revoke-keys"
Sep 06 10:44:14.293853 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:14.293844    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="005173d9-f44e-459f-8216-0c1c8f4dd95b" containerName="revoke-keys"
Sep 06 10:44:14.298435 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:14.298417    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-40f309-mbk7k"
Sep 06 10:44:14.301578 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:14.301426    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n5b2f\""
Sep 06 10:44:14.304974 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:14.304948    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-40f309-mbk7k"]
Sep 06 10:44:14.403849 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:14.403810    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a80476b1-ab65-43ab-afbf-923e1d1666f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-40f309-mbk7k\" (UID: \"a80476b1-ab65-43ab-afbf-923e1d1666f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-40f309-mbk7k"
Sep 06 10:44:14.504721 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:14.504681    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a80476b1-ab65-43ab-afbf-923e1d1666f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-40f309-mbk7k\" (UID: \"a80476b1-ab65-43ab-afbf-923e1d1666f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-40f309-mbk7k"
Sep 06 10:44:14.505352 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:14.505302    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a80476b1-ab65-43ab-afbf-923e1d1666f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-40f309-mbk7k\" (UID: \"a80476b1-ab65-43ab-afbf-923e1d1666f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-40f309-mbk7k"
Sep 06 10:44:14.514862 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:14.514827    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:14.612369 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:14.612262    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-40f309-mbk7k"
Sep 06 10:44:14.888906 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:14.888877    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-40f309-mbk7k"]
Sep 06 10:44:14.890373 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:44:14.890344    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda80476b1_ab65_43ab_afbf_923e1d1666f3.slice/crio-38714b26b3ce5e81a4d101c0c257db5bbb54614414d940b48e721277ca73615f WatchSource:0}: Error finding container 38714b26b3ce5e81a4d101c0c257db5bbb54614414d940b48e721277ca73615f: Status 404 returned error can't find the container with id 38714b26b3ce5e81a4d101c0c257db5bbb54614414d940b48e721277ca73615f
Sep 06 10:44:15.275504 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:15.275471    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-40f309-mbk7k" event={"ID":"a80476b1-ab65-43ab-afbf-923e1d1666f3","Type":"ContainerStarted","Data":"5329085b98b619a231768d0483cd4eee6acb11278ec8c35824f34b2dab6520cf"}
Sep 06 10:44:15.275632 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:15.275554    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-40f309-mbk7k" event={"ID":"a80476b1-ab65-43ab-afbf-923e1d1666f3","Type":"ContainerStarted","Data":"38714b26b3ce5e81a4d101c0c257db5bbb54614414d940b48e721277ca73615f"}
Sep 06 10:44:15.293004 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:15.292954    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-40f309-mbk7k" podStartSLOduration=1.292939947 podStartE2EDuration="1.292939947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:44:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:44:15.289395548 +0000 UTC m=+1347.067814960" watchObservedRunningTime="2026-09-06 10:44:15.292939947 +0000 UTC m=+1347.071359359"
Sep 06 10:44:15.587903 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:15.587871    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7840-93fc4d"]
Sep 06 10:44:15.591626 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:15.591610    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7840-93fc4d"
Sep 06 10:44:15.594267 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:15.594245    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-728g6\""
Sep 06 10:44:15.598044 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:15.597981    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7840-93fc4d"]
Sep 06 10:44:15.617091 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:15.617055    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n95wb\" (UniqueName: \"kubernetes.io/projected/1cafb494-bf09-4a92-a353-da5694f6c9e7-kube-api-access-n95wb\") pod \"mt-curl-7840-93fc4d\" (UID: \"1cafb494-bf09-4a92-a353-da5694f6c9e7\") " pod="opendatahub/mt-curl-7840-93fc4d"
Sep 06 10:44:15.718456 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:15.718416    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n95wb\" (UniqueName: \"kubernetes.io/projected/1cafb494-bf09-4a92-a353-da5694f6c9e7-kube-api-access-n95wb\") pod \"mt-curl-7840-93fc4d\" (UID: \"1cafb494-bf09-4a92-a353-da5694f6c9e7\") " pod="opendatahub/mt-curl-7840-93fc4d"
Sep 06 10:44:15.726900 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:15.726871    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n95wb\" (UniqueName: \"kubernetes.io/projected/1cafb494-bf09-4a92-a353-da5694f6c9e7-kube-api-access-n95wb\") pod \"mt-curl-7840-93fc4d\" (UID: \"1cafb494-bf09-4a92-a353-da5694f6c9e7\") " pod="opendatahub/mt-curl-7840-93fc4d"
Sep 06 10:44:15.903003 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:15.902912    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7840-93fc4d"
Sep 06 10:44:16.178021 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:16.177983    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7840-93fc4d"]
Sep 06 10:44:16.188675 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:16.188638    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 10:44:16.283993 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:16.283961    2561 generic.go:356] "Generic (PLEG): container finished" podID="a80476b1-ab65-43ab-afbf-923e1d1666f3" containerID="5329085b98b619a231768d0483cd4eee6acb11278ec8c35824f34b2dab6520cf" exitCode=0
Sep 06 10:44:16.284148 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:16.284049    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-40f309-mbk7k" event={"ID":"a80476b1-ab65-43ab-afbf-923e1d1666f3","Type":"ContainerDied","Data":"5329085b98b619a231768d0483cd4eee6acb11278ec8c35824f34b2dab6520cf"}
Sep 06 10:44:16.285253 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:16.285233    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7840-93fc4d" event={"ID":"1cafb494-bf09-4a92-a353-da5694f6c9e7","Type":"ContainerStarted","Data":"d6c79013df21e0f843ef3d4eb773fd8bb5e80f33b69fd8185d1e303f3367a57b"}
Sep 06 10:44:17.293382 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:17.293349    2561 generic.go:356] "Generic (PLEG): container finished" podID="1cafb494-bf09-4a92-a353-da5694f6c9e7" containerID="6b5016966da2d4f9708b737abbf734dc1f83316c68aecde87f46f491febf3bb9" exitCode=0
Sep 06 10:44:17.293777 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:17.293437    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7840-93fc4d" event={"ID":"1cafb494-bf09-4a92-a353-da5694f6c9e7","Type":"ContainerDied","Data":"6b5016966da2d4f9708b737abbf734dc1f83316c68aecde87f46f491febf3bb9"}
Sep 06 10:44:17.434742 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:17.434712    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-40f309-mbk7k"
Sep 06 10:44:17.536894 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:17.536854    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a80476b1-ab65-43ab-afbf-923e1d1666f3-maas-api-service-ca\") pod \"a80476b1-ab65-43ab-afbf-923e1d1666f3\" (UID: \"a80476b1-ab65-43ab-afbf-923e1d1666f3\") "
Sep 06 10:44:17.537330 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:17.537288    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a80476b1-ab65-43ab-afbf-923e1d1666f3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a80476b1-ab65-43ab-afbf-923e1d1666f3" (UID: "a80476b1-ab65-43ab-afbf-923e1d1666f3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:44:17.638369 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:17.638269    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a80476b1-ab65-43ab-afbf-923e1d1666f3-maas-api-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:17.992361 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:17.992312    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:18.301642 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.301555    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-40f309-mbk7k"
Sep 06 10:44:18.301642 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.301586    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-40f309-mbk7k" event={"ID":"a80476b1-ab65-43ab-afbf-923e1d1666f3","Type":"ContainerDied","Data":"38714b26b3ce5e81a4d101c0c257db5bbb54614414d940b48e721277ca73615f"}
Sep 06 10:44:18.301642 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.301636    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38714b26b3ce5e81a4d101c0c257db5bbb54614414d940b48e721277ca73615f"
Sep 06 10:44:18.434336 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.434293    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7840-93fc4d"
Sep 06 10:44:18.455025 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.455001    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7840-93fc4d_1cafb494-bf09-4a92-a353-da5694f6c9e7/mt-curl-7840-93fc4d/0.log"
Sep 06 10:44:18.477842 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.477810    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7840-93fc4d"]
Sep 06 10:44:18.481949 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.481925    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7840-93fc4d"]
Sep 06 10:44:18.547526 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.547489    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n95wb\" (UniqueName: \"kubernetes.io/projected/1cafb494-bf09-4a92-a353-da5694f6c9e7-kube-api-access-n95wb\") pod \"1cafb494-bf09-4a92-a353-da5694f6c9e7\" (UID: \"1cafb494-bf09-4a92-a353-da5694f6c9e7\") "
Sep 06 10:44:18.549595 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.549568    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cafb494-bf09-4a92-a353-da5694f6c9e7-kube-api-access-n95wb" (OuterVolumeSpecName: "kube-api-access-n95wb") pod "1cafb494-bf09-4a92-a353-da5694f6c9e7" (UID: "1cafb494-bf09-4a92-a353-da5694f6c9e7"). InnerVolumeSpecName "kube-api-access-n95wb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:44:18.595793 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.595753    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7840-74bc35"]
Sep 06 10:44:18.596179 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.596167    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a80476b1-ab65-43ab-afbf-923e1d1666f3" containerName="revoke-keys"
Sep 06 10:44:18.596230 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.596181    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a80476b1-ab65-43ab-afbf-923e1d1666f3" containerName="revoke-keys"
Sep 06 10:44:18.596230 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.596195    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cafb494-bf09-4a92-a353-da5694f6c9e7" containerName="mt-curl-7840-93fc4d"
Sep 06 10:44:18.596230 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.596200    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cafb494-bf09-4a92-a353-da5694f6c9e7" containerName="mt-curl-7840-93fc4d"
Sep 06 10:44:18.596339 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.596278    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a80476b1-ab65-43ab-afbf-923e1d1666f3" containerName="revoke-keys"
Sep 06 10:44:18.596339 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.596289    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cafb494-bf09-4a92-a353-da5694f6c9e7" containerName="mt-curl-7840-93fc4d"
Sep 06 10:44:18.599173 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.599157    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7840-74bc35"
Sep 06 10:44:18.607103 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.607019    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7840-74bc35"]
Sep 06 10:44:18.648501 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.648470    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmjp7\" (UniqueName: \"kubernetes.io/projected/485c30a9-0c49-4b80-bebe-3d566f87dae2-kube-api-access-jmjp7\") pod \"mt-curl-7840-74bc35\" (UID: \"485c30a9-0c49-4b80-bebe-3d566f87dae2\") " pod="opendatahub/mt-curl-7840-74bc35"
Sep 06 10:44:18.648664 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.648555    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n95wb\" (UniqueName: \"kubernetes.io/projected/1cafb494-bf09-4a92-a353-da5694f6c9e7-kube-api-access-n95wb\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:18.750039 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.750006    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmjp7\" (UniqueName: \"kubernetes.io/projected/485c30a9-0c49-4b80-bebe-3d566f87dae2-kube-api-access-jmjp7\") pod \"mt-curl-7840-74bc35\" (UID: \"485c30a9-0c49-4b80-bebe-3d566f87dae2\") " pod="opendatahub/mt-curl-7840-74bc35"
Sep 06 10:44:18.755789 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.755739    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cafb494-bf09-4a92-a353-da5694f6c9e7" path="/var/lib/kubelet/pods/1cafb494-bf09-4a92-a353-da5694f6c9e7/volumes"
Sep 06 10:44:18.764473 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.764442    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmjp7\" (UniqueName: \"kubernetes.io/projected/485c30a9-0c49-4b80-bebe-3d566f87dae2-kube-api-access-jmjp7\") pod \"mt-curl-7840-74bc35\" (UID: \"485c30a9-0c49-4b80-bebe-3d566f87dae2\") " pod="opendatahub/mt-curl-7840-74bc35"
Sep 06 10:44:18.910589 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.910558    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7840-74bc35"
Sep 06 10:44:18.994252 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.994218    2561 patch_prober.go:28] interesting pod/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 06 10:44:18.994450 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:18.994280    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2" podUID="41626d02-ed3a-4ecb-b65c-754d1e81b2cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 06 10:44:19.177364 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.177340    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:44:19.185964 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.185941    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7840-74bc35"]
Sep 06 10:44:19.187348 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:44:19.187300    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod485c30a9_0c49_4b80_bebe_3d566f87dae2.slice/crio-5d64ba1f6970548c826f3588f9c93a628183a930da79495a45a6bdc8a3a59070 WatchSource:0}: Error finding container 5d64ba1f6970548c826f3588f9c93a628183a930da79495a45a6bdc8a3a59070: Status 404 returned error can't find the container with id 5d64ba1f6970548c826f3588f9c93a628183a930da79495a45a6bdc8a3a59070
Sep 06 10:44:19.256023 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.255992    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-token\") pod \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") "
Sep 06 10:44:19.256189 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.256051    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istiod-ca-cert\") pod \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") "
Sep 06 10:44:19.256189 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.256139    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-credential-socket\") pod \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") "
Sep 06 10:44:19.256189 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.256167    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-workload-certs\") pod \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") "
Sep 06 10:44:19.256360 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.256192    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-data\") pod \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") "
Sep 06 10:44:19.256360 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.256225    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-envoy\") pod \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") "
Sep 06 10:44:19.256360 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.256249    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzjjm\" (UniqueName: \"kubernetes.io/projected/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-kube-api-access-kzjjm\") pod \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") "
Sep 06 10:44:19.256360 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.256281    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-podinfo\") pod \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") "
Sep 06 10:44:19.256360 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.256354    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-workload-socket\") pod \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\" (UID: \"41626d02-ed3a-4ecb-b65c-754d1e81b2cc\") "
Sep 06 10:44:19.256612 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.256526    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "41626d02-ed3a-4ecb-b65c-754d1e81b2cc" (UID: "41626d02-ed3a-4ecb-b65c-754d1e81b2cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:44:19.256612 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.256561    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-data" (OuterVolumeSpecName: "istio-data") pod "41626d02-ed3a-4ecb-b65c-754d1e81b2cc" (UID: "41626d02-ed3a-4ecb-b65c-754d1e81b2cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:44:19.256612 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.256576    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "41626d02-ed3a-4ecb-b65c-754d1e81b2cc" (UID: "41626d02-ed3a-4ecb-b65c-754d1e81b2cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:44:19.256612 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.256535    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "41626d02-ed3a-4ecb-b65c-754d1e81b2cc" (UID: "41626d02-ed3a-4ecb-b65c-754d1e81b2cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:44:19.256800 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.256733    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "41626d02-ed3a-4ecb-b65c-754d1e81b2cc" (UID: "41626d02-ed3a-4ecb-b65c-754d1e81b2cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:44:19.256852 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.256836    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:19.256892 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.256855    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:19.256937 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.256893    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:19.256937 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.256909    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:19.256937 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.256921    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:19.258316 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.258291    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-token" (OuterVolumeSpecName: "istio-token") pod "41626d02-ed3a-4ecb-b65c-754d1e81b2cc" (UID: "41626d02-ed3a-4ecb-b65c-754d1e81b2cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:44:19.258451 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.258339    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "41626d02-ed3a-4ecb-b65c-754d1e81b2cc" (UID: "41626d02-ed3a-4ecb-b65c-754d1e81b2cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:44:19.258451 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.258419    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "41626d02-ed3a-4ecb-b65c-754d1e81b2cc" (UID: "41626d02-ed3a-4ecb-b65c-754d1e81b2cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 10:44:19.258636 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.258616    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-kube-api-access-kzjjm" (OuterVolumeSpecName: "kube-api-access-kzjjm") pod "41626d02-ed3a-4ecb-b65c-754d1e81b2cc" (UID: "41626d02-ed3a-4ecb-b65c-754d1e81b2cc"). InnerVolumeSpecName "kube-api-access-kzjjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:44:19.309194 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.309150    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7840-74bc35" event={"ID":"485c30a9-0c49-4b80-bebe-3d566f87dae2","Type":"ContainerStarted","Data":"5d64ba1f6970548c826f3588f9c93a628183a930da79495a45a6bdc8a3a59070"}
Sep 06 10:44:19.310971 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.310941    2561 generic.go:356] "Generic (PLEG): container finished" podID="41626d02-ed3a-4ecb-b65c-754d1e81b2cc" containerID="4b16ebcb48a6267009dec682b0263e7b29fb6a341f49c17059958bf41a1e60ce" exitCode=0
Sep 06 10:44:19.311111 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.311003    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"
Sep 06 10:44:19.311111 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.311023    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2" event={"ID":"41626d02-ed3a-4ecb-b65c-754d1e81b2cc","Type":"ContainerDied","Data":"4b16ebcb48a6267009dec682b0263e7b29fb6a341f49c17059958bf41a1e60ce"}
Sep 06 10:44:19.311111 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.311067    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2" event={"ID":"41626d02-ed3a-4ecb-b65c-754d1e81b2cc","Type":"ContainerDied","Data":"a3b4ae7cbbebeb9c1bba5dbf56dfc49c99b03d4b4e2f1d535b66bc519cfc1e7f"}
Sep 06 10:44:19.311111 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.311088    2561 scope.go:117] "RemoveContainer" containerID="4b16ebcb48a6267009dec682b0263e7b29fb6a341f49c17059958bf41a1e60ce"
Sep 06 10:44:19.312551 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.312533    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7840-93fc4d"
Sep 06 10:44:19.321176 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.321151    2561 scope.go:117] "RemoveContainer" containerID="8d9c4081ba7b57cbf4b8310316268a1491360bb9d9ceebe3e4eda62128b705c2"
Sep 06 10:44:19.330161 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.330143    2561 scope.go:117] "RemoveContainer" containerID="4b16ebcb48a6267009dec682b0263e7b29fb6a341f49c17059958bf41a1e60ce"
Sep 06 10:44:19.330453 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:44:19.330433    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b16ebcb48a6267009dec682b0263e7b29fb6a341f49c17059958bf41a1e60ce\": container with ID starting with 4b16ebcb48a6267009dec682b0263e7b29fb6a341f49c17059958bf41a1e60ce not found: ID does not exist" containerID="4b16ebcb48a6267009dec682b0263e7b29fb6a341f49c17059958bf41a1e60ce"
Sep 06 10:44:19.330522 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.330461    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b16ebcb48a6267009dec682b0263e7b29fb6a341f49c17059958bf41a1e60ce"} err="failed to get container status \"4b16ebcb48a6267009dec682b0263e7b29fb6a341f49c17059958bf41a1e60ce\": rpc error: code = NotFound desc = could not find container \"4b16ebcb48a6267009dec682b0263e7b29fb6a341f49c17059958bf41a1e60ce\": container with ID starting with 4b16ebcb48a6267009dec682b0263e7b29fb6a341f49c17059958bf41a1e60ce not found: ID does not exist"
Sep 06 10:44:19.330522 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.330478    2561 scope.go:117] "RemoveContainer" containerID="8d9c4081ba7b57cbf4b8310316268a1491360bb9d9ceebe3e4eda62128b705c2"
Sep 06 10:44:19.330721 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:44:19.330705    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d9c4081ba7b57cbf4b8310316268a1491360bb9d9ceebe3e4eda62128b705c2\": container with ID starting with 8d9c4081ba7b57cbf4b8310316268a1491360bb9d9ceebe3e4eda62128b705c2 not found: ID does not exist" containerID="8d9c4081ba7b57cbf4b8310316268a1491360bb9d9ceebe3e4eda62128b705c2"
Sep 06 10:44:19.330762 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.330726    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d9c4081ba7b57cbf4b8310316268a1491360bb9d9ceebe3e4eda62128b705c2"} err="failed to get container status \"8d9c4081ba7b57cbf4b8310316268a1491360bb9d9ceebe3e4eda62128b705c2\": rpc error: code = NotFound desc = could not find container \"8d9c4081ba7b57cbf4b8310316268a1491360bb9d9ceebe3e4eda62128b705c2\": container with ID starting with 8d9c4081ba7b57cbf4b8310316268a1491360bb9d9ceebe3e4eda62128b705c2 not found: ID does not exist"
Sep 06 10:44:19.330762 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.330740    2561 scope.go:117] "RemoveContainer" containerID="6b5016966da2d4f9708b737abbf734dc1f83316c68aecde87f46f491febf3bb9"
Sep 06 10:44:19.341584 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.341560    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"]
Sep 06 10:44:19.344289 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.344269    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-616a10-openshift-default-5f49cd5b4b-75rb2"]
Sep 06 10:44:19.357497 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.357468    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:19.357497 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.357494    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:19.357616 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.357504    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzjjm\" (UniqueName: \"kubernetes.io/projected/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-kube-api-access-kzjjm\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:19.357616 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:19.357515    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/41626d02-ed3a-4ecb-b65c-754d1e81b2cc-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:20.320155 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:20.320119    2561 generic.go:356] "Generic (PLEG): container finished" podID="485c30a9-0c49-4b80-bebe-3d566f87dae2" containerID="03f5af640af934b7e0dfb213ab3ce03e7574361fea53f683815b92a5623d5b71" exitCode=0
Sep 06 10:44:20.320608 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:20.320212    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7840-74bc35" event={"ID":"485c30a9-0c49-4b80-bebe-3d566f87dae2","Type":"ContainerDied","Data":"03f5af640af934b7e0dfb213ab3ce03e7574361fea53f683815b92a5623d5b71"}
Sep 06 10:44:20.755220 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:20.755183    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41626d02-ed3a-4ecb-b65c-754d1e81b2cc" path="/var/lib/kubelet/pods/41626d02-ed3a-4ecb-b65c-754d1e81b2cc/volumes"
Sep 06 10:44:21.005835 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:21.005745    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:21.468985 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:21.468958    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7840-74bc35"
Sep 06 10:44:21.488520 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:21.488475    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7840-74bc35_485c30a9-0c49-4b80-bebe-3d566f87dae2/mt-curl-7840-74bc35/0.log"
Sep 06 10:44:21.512073 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:21.512040    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7840-74bc35"]
Sep 06 10:44:21.517931 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:21.517897    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7840-74bc35"]
Sep 06 10:44:21.579462 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:21.579384    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmjp7\" (UniqueName: \"kubernetes.io/projected/485c30a9-0c49-4b80-bebe-3d566f87dae2-kube-api-access-jmjp7\") pod \"485c30a9-0c49-4b80-bebe-3d566f87dae2\" (UID: \"485c30a9-0c49-4b80-bebe-3d566f87dae2\") "
Sep 06 10:44:21.581371 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:21.581350    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/485c30a9-0c49-4b80-bebe-3d566f87dae2-kube-api-access-jmjp7" (OuterVolumeSpecName: "kube-api-access-jmjp7") pod "485c30a9-0c49-4b80-bebe-3d566f87dae2" (UID: "485c30a9-0c49-4b80-bebe-3d566f87dae2"). InnerVolumeSpecName "kube-api-access-jmjp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:44:21.680477 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:21.680443    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmjp7\" (UniqueName: \"kubernetes.io/projected/485c30a9-0c49-4b80-bebe-3d566f87dae2-kube-api-access-jmjp7\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:22.336290 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:22.336258    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7840-74bc35"
Sep 06 10:44:22.336503 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:22.336302    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d64ba1f6970548c826f3588f9c93a628183a930da79495a45a6bdc8a3a59070"
Sep 06 10:44:22.345829 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:44:22.345804    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7840-74bc35\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="485c30a9-0c49-4b80-bebe-3d566f87dae2" pod="opendatahub/mt-curl-7840-74bc35"
Sep 06 10:44:22.754331 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:22.754279    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="485c30a9-0c49-4b80-bebe-3d566f87dae2" path="/var/lib/kubelet/pods/485c30a9-0c49-4b80-bebe-3d566f87dae2/volumes"
Sep 06 10:44:23.890766 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:23.890728    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:24.423716 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:24.423686    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:25.733567 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:25.733539    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:30.017292 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:30.017256    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:30.081084 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:30.081053    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:30.138264 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:30.138229    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:30.220932 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:30.220896    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-40f309-mbk7k"]
Sep 06 10:44:30.224373 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:30.224314    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:30.225672 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:30.225648    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-40f309-mbk7k"]
Sep 06 10:44:30.282893 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:30.282835    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:30.592094 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:30.592019    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:30.754562 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:30.754520    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a80476b1-ab65-43ab-afbf-923e1d1666f3" path="/var/lib/kubelet/pods/a80476b1-ab65-43ab-afbf-923e1d1666f3/volumes"
Sep 06 10:44:31.957184 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:31.957138    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:32.058058 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:32.058010    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:36.304820 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:36.304774    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:36.372595 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:36.372541    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:36.548647 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:36.548610    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"]
Sep 06 10:44:36.548899 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:36.548873    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh" podUID="a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" containerName="istio-proxy" containerID="cri-o://f9d7b00026ae129cc67d1bc47ece2a397fa16764c053113408b113000600a822" gracePeriod=30
Sep 06 10:44:36.564056 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:36.563933    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:36.931116 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:36.931087    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-27a2b9-fdg27"]
Sep 06 10:44:36.931546 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:36.931533    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41626d02-ed3a-4ecb-b65c-754d1e81b2cc" containerName="istio-proxy"
Sep 06 10:44:36.931610 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:36.931548    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="41626d02-ed3a-4ecb-b65c-754d1e81b2cc" containerName="istio-proxy"
Sep 06 10:44:36.931610 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:36.931557    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485c30a9-0c49-4b80-bebe-3d566f87dae2" containerName="mt-curl-7840-74bc35"
Sep 06 10:44:36.931610 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:36.931562    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="485c30a9-0c49-4b80-bebe-3d566f87dae2" containerName="mt-curl-7840-74bc35"
Sep 06 10:44:36.931703 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:36.931643    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="41626d02-ed3a-4ecb-b65c-754d1e81b2cc" containerName="istio-proxy"
Sep 06 10:44:36.931703 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:36.931650    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="485c30a9-0c49-4b80-bebe-3d566f87dae2" containerName="mt-curl-7840-74bc35"
Sep 06 10:44:36.931703 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:36.931659    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="41626d02-ed3a-4ecb-b65c-754d1e81b2cc" containerName="istio-proxy"
Sep 06 10:44:36.935484 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:36.935460    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-27a2b9-fdg27"
Sep 06 10:44:36.938876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:36.938830    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n5b2f\""
Sep 06 10:44:36.942381 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:36.942354    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-27a2b9-fdg27"]
Sep 06 10:44:37.041117 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:37.041080    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92db91f5-a635-4dc8-a413-b12fe68864fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-27a2b9-fdg27\" (UID: \"92db91f5-a635-4dc8-a413-b12fe68864fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-27a2b9-fdg27"
Sep 06 10:44:37.097058 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:37.097022    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:37.142185 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:37.142145    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92db91f5-a635-4dc8-a413-b12fe68864fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-27a2b9-fdg27\" (UID: \"92db91f5-a635-4dc8-a413-b12fe68864fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-27a2b9-fdg27"
Sep 06 10:44:37.142794 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:37.142775    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92db91f5-a635-4dc8-a413-b12fe68864fd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-27a2b9-fdg27\" (UID: \"92db91f5-a635-4dc8-a413-b12fe68864fd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-27a2b9-fdg27"
Sep 06 10:44:37.249833 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:37.249746    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-27a2b9-fdg27"
Sep 06 10:44:37.523038 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:37.523002    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-27a2b9-fdg27"]
Sep 06 10:44:37.524207 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:44:37.524181    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92db91f5_a635_4dc8_a413_b12fe68864fd.slice/crio-9d17e162fdb5edcce54115d2152a51c90b195034786ffdcb0a31ce800ffb7750 WatchSource:0}: Error finding container 9d17e162fdb5edcce54115d2152a51c90b195034786ffdcb0a31ce800ffb7750: Status 404 returned error can't find the container with id 9d17e162fdb5edcce54115d2152a51c90b195034786ffdcb0a31ce800ffb7750
Sep 06 10:44:38.455357 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:38.455301    2561 generic.go:356] "Generic (PLEG): container finished" podID="92db91f5-a635-4dc8-a413-b12fe68864fd" containerID="60ba10527f2be3375490b67f21b3e55c6c0b797d8f92b66b8c5db0331cfb7898" exitCode=0
Sep 06 10:44:38.455524 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:38.455385    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-27a2b9-fdg27" event={"ID":"92db91f5-a635-4dc8-a413-b12fe68864fd","Type":"ContainerDied","Data":"60ba10527f2be3375490b67f21b3e55c6c0b797d8f92b66b8c5db0331cfb7898"}
Sep 06 10:44:38.455524 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:38.455458    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-27a2b9-fdg27" event={"ID":"92db91f5-a635-4dc8-a413-b12fe68864fd","Type":"ContainerStarted","Data":"9d17e162fdb5edcce54115d2152a51c90b195034786ffdcb0a31ce800ffb7750"}
Sep 06 10:44:39.601219 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:39.601197    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-27a2b9-fdg27"
Sep 06 10:44:39.665703 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:39.665668    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92db91f5-a635-4dc8-a413-b12fe68864fd-maas-api-service-ca\") pod \"92db91f5-a635-4dc8-a413-b12fe68864fd\" (UID: \"92db91f5-a635-4dc8-a413-b12fe68864fd\") "
Sep 06 10:44:39.665992 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:39.665970    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92db91f5-a635-4dc8-a413-b12fe68864fd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "92db91f5-a635-4dc8-a413-b12fe68864fd" (UID: "92db91f5-a635-4dc8-a413-b12fe68864fd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:44:39.771398 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:39.771279    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92db91f5-a635-4dc8-a413-b12fe68864fd-maas-api-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:40.473284 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:40.473236    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-27a2b9-fdg27" event={"ID":"92db91f5-a635-4dc8-a413-b12fe68864fd","Type":"ContainerDied","Data":"9d17e162fdb5edcce54115d2152a51c90b195034786ffdcb0a31ce800ffb7750"}
Sep 06 10:44:40.473514 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:40.473310    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d17e162fdb5edcce54115d2152a51c90b195034786ffdcb0a31ce800ffb7750"
Sep 06 10:44:40.473514 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:40.473398    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-27a2b9-fdg27"
Sep 06 10:44:40.524719 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:44:40.524674    2561 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92db91f5_a635_4dc8_a413_b12fe68864fd.slice\": RecentStats: unable to find data in memory cache]"
Sep 06 10:44:41.814640 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.814561    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:44:41.894610 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.894570    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-envoy\") pod \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") "
Sep 06 10:44:41.894610 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.894619    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-workload-certs\") pod \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") "
Sep 06 10:44:41.894873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.894645    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-token\") pod \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") "
Sep 06 10:44:41.894873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.894672    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-data\") pod \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") "
Sep 06 10:44:41.894873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.894698    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istiod-ca-cert\") pod \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") "
Sep 06 10:44:41.894873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.894716    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-podinfo\") pod \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") "
Sep 06 10:44:41.894873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.894756    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-workload-socket\") pod \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") "
Sep 06 10:44:41.894873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.894816    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bsk8\" (UniqueName: \"kubernetes.io/projected/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-kube-api-access-7bsk8\") pod \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") "
Sep 06 10:44:41.894873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.894871    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-credential-socket\") pod \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\" (UID: \"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302\") "
Sep 06 10:44:41.895242 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.895030    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-data" (OuterVolumeSpecName: "istio-data") pod "a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" (UID: "a127ba01-e8c1-4e52-86b4-d8d3c1ab8302"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:44:41.895242 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.895054    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" (UID: "a127ba01-e8c1-4e52-86b4-d8d3c1ab8302"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:44:41.895375 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.895244    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" (UID: "a127ba01-e8c1-4e52-86b4-d8d3c1ab8302"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:44:41.895375 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.895260    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:41.895375 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.895251    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" (UID: "a127ba01-e8c1-4e52-86b4-d8d3c1ab8302"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:44:41.895375 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.895279    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:41.895375 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.895306    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" (UID: "a127ba01-e8c1-4e52-86b4-d8d3c1ab8302"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:44:41.896926 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.896893    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" (UID: "a127ba01-e8c1-4e52-86b4-d8d3c1ab8302"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:44:41.897141 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.897121    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-kube-api-access-7bsk8" (OuterVolumeSpecName: "kube-api-access-7bsk8") pod "a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" (UID: "a127ba01-e8c1-4e52-86b4-d8d3c1ab8302"). InnerVolumeSpecName "kube-api-access-7bsk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:44:41.897350 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.897314    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" (UID: "a127ba01-e8c1-4e52-86b4-d8d3c1ab8302"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 10:44:41.897405 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.897344    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-token" (OuterVolumeSpecName: "istio-token") pod "a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" (UID: "a127ba01-e8c1-4e52-86b4-d8d3c1ab8302"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:44:41.995824 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.995784    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:41.995824 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.995815    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bsk8\" (UniqueName: \"kubernetes.io/projected/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-kube-api-access-7bsk8\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:41.995824 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.995825    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:41.995824 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.995834    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:41.996085 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.995842    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:41.996085 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.995850    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:41.996085 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:41.995857    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:42.487333 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:42.487280    2561 generic.go:356] "Generic (PLEG): container finished" podID="a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" containerID="f9d7b00026ae129cc67d1bc47ece2a397fa16764c053113408b113000600a822" exitCode=0
Sep 06 10:44:42.487523 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:42.487342    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"
Sep 06 10:44:42.487523 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:42.487361    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh" event={"ID":"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302","Type":"ContainerDied","Data":"f9d7b00026ae129cc67d1bc47ece2a397fa16764c053113408b113000600a822"}
Sep 06 10:44:42.487523 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:42.487414    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh" event={"ID":"a127ba01-e8c1-4e52-86b4-d8d3c1ab8302","Type":"ContainerDied","Data":"864d11ac804e86d423639e29692e7b82eaf90c8c32e063a26f187b3a4f7a1775"}
Sep 06 10:44:42.487523 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:42.487436    2561 scope.go:117] "RemoveContainer" containerID="f9d7b00026ae129cc67d1bc47ece2a397fa16764c053113408b113000600a822"
Sep 06 10:44:42.498599 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:42.498570    2561 scope.go:117] "RemoveContainer" containerID="0dc0dcb20f9514c9bea75717e882a6b158eff7851928da92d082c1e8b0db67ae"
Sep 06 10:44:42.509173 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:42.509147    2561 scope.go:117] "RemoveContainer" containerID="f9d7b00026ae129cc67d1bc47ece2a397fa16764c053113408b113000600a822"
Sep 06 10:44:42.509600 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:44:42.509578    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9d7b00026ae129cc67d1bc47ece2a397fa16764c053113408b113000600a822\": container with ID starting with f9d7b00026ae129cc67d1bc47ece2a397fa16764c053113408b113000600a822 not found: ID does not exist" containerID="f9d7b00026ae129cc67d1bc47ece2a397fa16764c053113408b113000600a822"
Sep 06 10:44:42.509696 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:42.509609    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9d7b00026ae129cc67d1bc47ece2a397fa16764c053113408b113000600a822"} err="failed to get container status \"f9d7b00026ae129cc67d1bc47ece2a397fa16764c053113408b113000600a822\": rpc error: code = NotFound desc = could not find container \"f9d7b00026ae129cc67d1bc47ece2a397fa16764c053113408b113000600a822\": container with ID starting with f9d7b00026ae129cc67d1bc47ece2a397fa16764c053113408b113000600a822 not found: ID does not exist"
Sep 06 10:44:42.509696 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:42.509627    2561 scope.go:117] "RemoveContainer" containerID="0dc0dcb20f9514c9bea75717e882a6b158eff7851928da92d082c1e8b0db67ae"
Sep 06 10:44:42.509963 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:44:42.509926    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dc0dcb20f9514c9bea75717e882a6b158eff7851928da92d082c1e8b0db67ae\": container with ID starting with 0dc0dcb20f9514c9bea75717e882a6b158eff7851928da92d082c1e8b0db67ae not found: ID does not exist" containerID="0dc0dcb20f9514c9bea75717e882a6b158eff7851928da92d082c1e8b0db67ae"
Sep 06 10:44:42.510030 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:42.509963    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dc0dcb20f9514c9bea75717e882a6b158eff7851928da92d082c1e8b0db67ae"} err="failed to get container status \"0dc0dcb20f9514c9bea75717e882a6b158eff7851928da92d082c1e8b0db67ae\": rpc error: code = NotFound desc = could not find container \"0dc0dcb20f9514c9bea75717e882a6b158eff7851928da92d082c1e8b0db67ae\": container with ID starting with 0dc0dcb20f9514c9bea75717e882a6b158eff7851928da92d082c1e8b0db67ae not found: ID does not exist"
Sep 06 10:44:42.511782 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:42.511751    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"]
Sep 06 10:44:42.518457 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:42.518429    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-40f309-openshift-default-6866fd8f8b-vjzfh"]
Sep 06 10:44:42.762353 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:42.762240    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" path="/var/lib/kubelet/pods/a127ba01-e8c1-4e52-86b4-d8d3c1ab8302/volumes"
Sep 06 10:44:44.532572 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:44.532543    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:47.455982 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:47.455951    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:47.556378 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:47.556343    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:47.660789 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:47.660754    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-27a2b9-fdg27"]
Sep 06 10:44:47.660974 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:47.660946    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:47.663372 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:47.663347    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-27a2b9-fdg27"]
Sep 06 10:44:47.720985 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:47.720906    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:48.031805 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:48.031720    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:48.755772 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:48.755731    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92db91f5-a635-4dc8-a413-b12fe68864fd" path="/var/lib/kubelet/pods/92db91f5-a635-4dc8-a413-b12fe68864fd/volumes"
Sep 06 10:44:49.085767 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:49.085667    2561 scope.go:117] "RemoveContainer" containerID="d1ac5881f26a3584aceed7e91cdd92729849ab4e84b70d614548d71fff1c854b"
Sep 06 10:44:53.632498 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:53.632466    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:53.732315 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:53.732285    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:53.785441 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:53.785408    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:53.895266 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:53.895186    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:54.225537 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.225505    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-71e210-2xpjv"]
Sep 06 10:44:54.226004 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.225984    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92db91f5-a635-4dc8-a413-b12fe68864fd" containerName="revoke-keys"
Sep 06 10:44:54.226004 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.226003    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="92db91f5-a635-4dc8-a413-b12fe68864fd" containerName="revoke-keys"
Sep 06 10:44:54.226221 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.226036    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" containerName="istio-proxy"
Sep 06 10:44:54.226221 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.226044    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" containerName="istio-proxy"
Sep 06 10:44:54.226221 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.226057    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41626d02-ed3a-4ecb-b65c-754d1e81b2cc" containerName="istio-proxy"
Sep 06 10:44:54.226221 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.226065    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="41626d02-ed3a-4ecb-b65c-754d1e81b2cc" containerName="istio-proxy"
Sep 06 10:44:54.226221 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.226073    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" containerName="istio-proxy"
Sep 06 10:44:54.226221 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.226080    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" containerName="istio-proxy"
Sep 06 10:44:54.226221 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.226174    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="92db91f5-a635-4dc8-a413-b12fe68864fd" containerName="revoke-keys"
Sep 06 10:44:54.226221 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.226192    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" containerName="istio-proxy"
Sep 06 10:44:54.226221 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.226204    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a127ba01-e8c1-4e52-86b4-d8d3c1ab8302" containerName="istio-proxy"
Sep 06 10:44:54.231105 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.231085    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-71e210-2xpjv"
Sep 06 10:44:54.233524 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.233502    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n5b2f\""
Sep 06 10:44:54.238815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.238790    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-71e210-2xpjv"]
Sep 06 10:44:54.311070 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.311034    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1e49a40-d362-4d69-af9a-e7e8a9f52ec0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-71e210-2xpjv\" (UID: \"f1e49a40-d362-4d69-af9a-e7e8a9f52ec0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-71e210-2xpjv"
Sep 06 10:44:54.413983 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.413934    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1e49a40-d362-4d69-af9a-e7e8a9f52ec0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-71e210-2xpjv\" (UID: \"f1e49a40-d362-4d69-af9a-e7e8a9f52ec0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-71e210-2xpjv"
Sep 06 10:44:54.414953 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.414924    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1e49a40-d362-4d69-af9a-e7e8a9f52ec0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-71e210-2xpjv\" (UID: \"f1e49a40-d362-4d69-af9a-e7e8a9f52ec0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-71e210-2xpjv"
Sep 06 10:44:54.426072 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.426044    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:44:54.544704 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.544618    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-71e210-2xpjv"
Sep 06 10:44:54.820623 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:54.820598    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-71e210-2xpjv"]
Sep 06 10:44:54.822551 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:44:54.822524    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1e49a40_d362_4d69_af9a_e7e8a9f52ec0.slice/crio-33174ca0430c41e7da1fa8541ddd9176098d0e9da8b82b64fd3e3e629cc50aeb WatchSource:0}: Error finding container 33174ca0430c41e7da1fa8541ddd9176098d0e9da8b82b64fd3e3e629cc50aeb: Status 404 returned error can't find the container with id 33174ca0430c41e7da1fa8541ddd9176098d0e9da8b82b64fd3e3e629cc50aeb
Sep 06 10:44:55.574682 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:55.574641    2561 generic.go:356] "Generic (PLEG): container finished" podID="f1e49a40-d362-4d69-af9a-e7e8a9f52ec0" containerID="255ba0a6f53d55b245d5862b354813dda7730ebc2f92af9f65d024be371c9e6a" exitCode=0
Sep 06 10:44:55.574819 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:55.574730    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-71e210-2xpjv" event={"ID":"f1e49a40-d362-4d69-af9a-e7e8a9f52ec0","Type":"ContainerDied","Data":"255ba0a6f53d55b245d5862b354813dda7730ebc2f92af9f65d024be371c9e6a"}
Sep 06 10:44:55.574863 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:55.574817    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-71e210-2xpjv" event={"ID":"f1e49a40-d362-4d69-af9a-e7e8a9f52ec0","Type":"ContainerStarted","Data":"33174ca0430c41e7da1fa8541ddd9176098d0e9da8b82b64fd3e3e629cc50aeb"}
Sep 06 10:44:56.719421 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:56.719396    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-71e210-2xpjv"
Sep 06 10:44:56.839932 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:56.839844    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1e49a40-d362-4d69-af9a-e7e8a9f52ec0-maas-api-service-ca\") pod \"f1e49a40-d362-4d69-af9a-e7e8a9f52ec0\" (UID: \"f1e49a40-d362-4d69-af9a-e7e8a9f52ec0\") "
Sep 06 10:44:56.840226 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:56.840201    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1e49a40-d362-4d69-af9a-e7e8a9f52ec0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f1e49a40-d362-4d69-af9a-e7e8a9f52ec0" (UID: "f1e49a40-d362-4d69-af9a-e7e8a9f52ec0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:44:56.941350 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:56.941289    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1e49a40-d362-4d69-af9a-e7e8a9f52ec0-maas-api-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:44:57.589223 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:57.589192    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-71e210-2xpjv"
Sep 06 10:44:57.589427 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:57.589192    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-71e210-2xpjv" event={"ID":"f1e49a40-d362-4d69-af9a-e7e8a9f52ec0","Type":"ContainerDied","Data":"33174ca0430c41e7da1fa8541ddd9176098d0e9da8b82b64fd3e3e629cc50aeb"}
Sep 06 10:44:57.589427 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:44:57.589316    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33174ca0430c41e7da1fa8541ddd9176098d0e9da8b82b64fd3e3e629cc50aeb"
Sep 06 10:45:00.139468 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.139430    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29811525-5xgfl"]
Sep 06 10:45:00.140091 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.140071    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1e49a40-d362-4d69-af9a-e7e8a9f52ec0" containerName="revoke-keys"
Sep 06 10:45:00.140160 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.140096    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1e49a40-d362-4d69-af9a-e7e8a9f52ec0" containerName="revoke-keys"
Sep 06 10:45:00.140235 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.140224    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1e49a40-d362-4d69-af9a-e7e8a9f52ec0" containerName="revoke-keys"
Sep 06 10:45:00.144427 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.144403    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-71e210-29811525-txszs"]
Sep 06 10:45:00.144571 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.144522    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29811525-5xgfl"
Sep 06 10:45:00.147043 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.146844    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n5b2f\""
Sep 06 10:45:00.148295 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.148265    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-682ea0-29811525-qs5xd"]
Sep 06 10:45:00.148627 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.148527    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-71e210-29811525-txszs"
Sep 06 10:45:00.156146 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.156120    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29811525-5xgfl"]
Sep 06 10:45:00.156308 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.156296    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-71e210-29811525-txszs"]
Sep 06 10:45:00.156467 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.156444    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-682ea0-29811525-qs5xd"
Sep 06 10:45:00.165489 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.165457    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29811525-5xgfl"
Sep 06 10:45:00.177385 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.177357    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-71e210-29811525-txszs"
Sep 06 10:45:00.178544 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.178519    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-682ea0-29811525-qs5xd"]
Sep 06 10:45:00.226451 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.226422    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-682ea0-29811525-qs5xd"
Sep 06 10:45:00.455385 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.455362    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29811525-5xgfl"]
Sep 06 10:45:00.457266 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:45:00.457244    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod608e5ada_ff04_4f82_91a1_40b242cf9b83.slice/crio-fde4ee1e1aa6ba9d2eba590161eb9d23b5705658e5d930cb3a3774a27eba08ee WatchSource:0}: Error finding container fde4ee1e1aa6ba9d2eba590161eb9d23b5705658e5d930cb3a3774a27eba08ee: Status 404 returned error can't find the container with id fde4ee1e1aa6ba9d2eba590161eb9d23b5705658e5d930cb3a3774a27eba08ee
Sep 06 10:45:00.464182 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.464159    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-71e210-29811525-txszs"]
Sep 06 10:45:00.464551 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:45:00.464529    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe08dde7_88ef_4d33_92c8_346d38adc436.slice/crio-19726c761c6661dc1586e401748955b8b8c74f0b2dc96265d3729a1b0bf872b5 WatchSource:0}: Error finding container 19726c761c6661dc1586e401748955b8b8c74f0b2dc96265d3729a1b0bf872b5: Status 404 returned error can't find the container with id 19726c761c6661dc1586e401748955b8b8c74f0b2dc96265d3729a1b0bf872b5
Sep 06 10:45:00.526191 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.526157    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-682ea0-29811525-qs5xd"]
Sep 06 10:45:00.527205 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:45:00.527181    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94040711_644f_46d5_bfb9_0273168c4f5a.slice/crio-08548bc104aefd85d08a4c61c8ea09bfe56c2c6c6871867ec956487df25c4537 WatchSource:0}: Error finding container 08548bc104aefd85d08a4c61c8ea09bfe56c2c6c6871867ec956487df25c4537: Status 404 returned error can't find the container with id 08548bc104aefd85d08a4c61c8ea09bfe56c2c6c6871867ec956487df25c4537
Sep 06 10:45:00.608019 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.607990    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-682ea0-29811525-qs5xd" event={"ID":"94040711-644f-46d5-bfb9-0273168c4f5a","Type":"ContainerStarted","Data":"08548bc104aefd85d08a4c61c8ea09bfe56c2c6c6871867ec956487df25c4537"}
Sep 06 10:45:00.609194 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.609175    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-71e210-29811525-txszs" event={"ID":"be08dde7-88ef-4d33-92c8-346d38adc436","Type":"ContainerStarted","Data":"19726c761c6661dc1586e401748955b8b8c74f0b2dc96265d3729a1b0bf872b5"}
Sep 06 10:45:00.610307 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:00.610285    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29811525-5xgfl" event={"ID":"608e5ada-ff04-4f82-91a1-40b242cf9b83","Type":"ContainerStarted","Data":"fde4ee1e1aa6ba9d2eba590161eb9d23b5705658e5d930cb3a3774a27eba08ee"}
Sep 06 10:45:01.618276 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:01.618242    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-682ea0-29811525-qs5xd" event={"ID":"94040711-644f-46d5-bfb9-0273168c4f5a","Type":"ContainerStarted","Data":"73c712c349d252190c2e9c2ed7c98bd902273a6f47ac4ec1d3a0b60357964bff"}
Sep 06 10:45:01.619849 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:01.619814    2561 generic.go:356] "Generic (PLEG): container finished" podID="be08dde7-88ef-4d33-92c8-346d38adc436" containerID="e16097bd0d5861e066883c41be61a7b685cbcc8265bd3367e22868f0b37b645d" exitCode=0
Sep 06 10:45:01.619963 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:01.619891    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-71e210-29811525-txszs" event={"ID":"be08dde7-88ef-4d33-92c8-346d38adc436","Type":"ContainerDied","Data":"e16097bd0d5861e066883c41be61a7b685cbcc8265bd3367e22868f0b37b645d"}
Sep 06 10:45:01.621447 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:01.621418    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29811525-5xgfl" event={"ID":"608e5ada-ff04-4f82-91a1-40b242cf9b83","Type":"ContainerStarted","Data":"a219b75fa4728028401c648d66df46a7c165abded28689cac2600a6cf4134bd2"}
Sep 06 10:45:01.635265 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:01.635226    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-682ea0-29811525-qs5xd" podStartSLOduration=1.635211694 podStartE2EDuration="1.635211694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:45:01.632304503 +0000 UTC m=+1393.410723917" watchObservedRunningTime="2026-09-06 10:45:01.635211694 +0000 UTC m=+1393.413631106"
Sep 06 10:45:01.650973 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:01.650929    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29811525-5xgfl" podStartSLOduration=1.6509141889999999 podStartE2EDuration="1.650914189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:45:01.647592914 +0000 UTC m=+1393.426012328" watchObservedRunningTime="2026-09-06 10:45:01.650914189 +0000 UTC m=+1393.429333601"
Sep 06 10:45:02.629741 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:02.629700    2561 generic.go:356] "Generic (PLEG): container finished" podID="94040711-644f-46d5-bfb9-0273168c4f5a" containerID="73c712c349d252190c2e9c2ed7c98bd902273a6f47ac4ec1d3a0b60357964bff" exitCode=0
Sep 06 10:45:02.630178 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:02.629793    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-682ea0-29811525-qs5xd" event={"ID":"94040711-644f-46d5-bfb9-0273168c4f5a","Type":"ContainerDied","Data":"73c712c349d252190c2e9c2ed7c98bd902273a6f47ac4ec1d3a0b60357964bff"}
Sep 06 10:45:02.631438 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:02.631412    2561 generic.go:356] "Generic (PLEG): container finished" podID="608e5ada-ff04-4f82-91a1-40b242cf9b83" containerID="a219b75fa4728028401c648d66df46a7c165abded28689cac2600a6cf4134bd2" exitCode=0
Sep 06 10:45:02.631542 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:02.631490    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29811525-5xgfl" event={"ID":"608e5ada-ff04-4f82-91a1-40b242cf9b83","Type":"ContainerDied","Data":"a219b75fa4728028401c648d66df46a7c165abded28689cac2600a6cf4134bd2"}
Sep 06 10:45:02.776165 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:02.776139    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-71e210-29811525-txszs"
Sep 06 10:45:03.639310 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:03.639266    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-71e210-29811525-txszs"
Sep 06 10:45:03.639310 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:03.639301    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-71e210-29811525-txszs" event={"ID":"be08dde7-88ef-4d33-92c8-346d38adc436","Type":"ContainerDied","Data":"19726c761c6661dc1586e401748955b8b8c74f0b2dc96265d3729a1b0bf872b5"}
Sep 06 10:45:03.639789 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:03.639371    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19726c761c6661dc1586e401748955b8b8c74f0b2dc96265d3729a1b0bf872b5"
Sep 06 10:45:03.810227 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:03.810204    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-682ea0-29811525-qs5xd"
Sep 06 10:45:03.814245 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:03.814216    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29811525-5xgfl"
Sep 06 10:45:04.648047 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:04.648010    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-682ea0-29811525-qs5xd"
Sep 06 10:45:04.648047 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:04.648042    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-682ea0-29811525-qs5xd" event={"ID":"94040711-644f-46d5-bfb9-0273168c4f5a","Type":"ContainerDied","Data":"08548bc104aefd85d08a4c61c8ea09bfe56c2c6c6871867ec956487df25c4537"}
Sep 06 10:45:04.648582 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:04.648119    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08548bc104aefd85d08a4c61c8ea09bfe56c2c6c6871867ec956487df25c4537"
Sep 06 10:45:04.649497 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:04.649476    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29811525-5xgfl"
Sep 06 10:45:04.649612 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:04.649521    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29811525-5xgfl" event={"ID":"608e5ada-ff04-4f82-91a1-40b242cf9b83","Type":"ContainerDied","Data":"fde4ee1e1aa6ba9d2eba590161eb9d23b5705658e5d930cb3a3774a27eba08ee"}
Sep 06 10:45:04.649612 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:04.649559    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fde4ee1e1aa6ba9d2eba590161eb9d23b5705658e5d930cb3a3774a27eba08ee"
Sep 06 10:45:04.956684 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:04.956618    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:45:04.963024 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:04.962997    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-71e210-29811525-txszs"]
Sep 06 10:45:04.969692 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:04.969670    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-71e210-29811525-txszs"]
Sep 06 10:45:05.038738 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:05.038708    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:45:05.100379 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:05.100345    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:45:05.172216 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:05.172185    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-71e210-2xpjv"]
Sep 06 10:45:05.174049 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:05.174022    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:45:05.175011 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:05.174990    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-71e210-2xpjv"]
Sep 06 10:45:05.231795 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:05.231691    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:45:05.535473 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:05.535382    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:45:06.754802 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:06.754769    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be08dde7-88ef-4d33-92c8-346d38adc436" path="/var/lib/kubelet/pods/be08dde7-88ef-4d33-92c8-346d38adc436/volumes"
Sep 06 10:45:06.755156 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:06.755069    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1e49a40-d362-4d69-af9a-e7e8a9f52ec0" path="/var/lib/kubelet/pods/f1e49a40-d362-4d69-af9a-e7e8a9f52ec0/volumes"
Sep 06 10:45:11.347976 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:11.347943    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:45:11.413228 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:11.413186    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:45:11.648247 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:11.648159    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"]
Sep 06 10:45:11.648425 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:11.648384    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl" podUID="7a85715d-7ba2-4ff6-ad58-d486ce135088" containerName="istio-proxy" containerID="cri-o://b216bef472cacd038f2af308724f7b7441f7fb036fd7627ab4bf76390c956a2a" gracePeriod=30
Sep 06 10:45:11.719195 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:11.719159    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:45:16.906419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:16.906390    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:45:17.043589 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.043496    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a85715d-7ba2-4ff6-ad58-d486ce135088-istiod-ca-cert\") pod \"7a85715d-7ba2-4ff6-ad58-d486ce135088\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") "
Sep 06 10:45:17.043589 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.043549    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-envoy\") pod \"7a85715d-7ba2-4ff6-ad58-d486ce135088\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") "
Sep 06 10:45:17.043839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.043589    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-workload-socket\") pod \"7a85715d-7ba2-4ff6-ad58-d486ce135088\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") "
Sep 06 10:45:17.043839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.043628    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmfsf\" (UniqueName: \"kubernetes.io/projected/7a85715d-7ba2-4ff6-ad58-d486ce135088-kube-api-access-vmfsf\") pod \"7a85715d-7ba2-4ff6-ad58-d486ce135088\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") "
Sep 06 10:45:17.043839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.043663    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-data\") pod \"7a85715d-7ba2-4ff6-ad58-d486ce135088\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") "
Sep 06 10:45:17.044011 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.043909    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7a85715d-7ba2-4ff6-ad58-d486ce135088" (UID: "7a85715d-7ba2-4ff6-ad58-d486ce135088"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:45:17.044011 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.043998    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-data" (OuterVolumeSpecName: "istio-data") pod "7a85715d-7ba2-4ff6-ad58-d486ce135088" (UID: "7a85715d-7ba2-4ff6-ad58-d486ce135088"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:45:17.044122 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.043714    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-workload-certs\") pod \"7a85715d-7ba2-4ff6-ad58-d486ce135088\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") "
Sep 06 10:45:17.044122 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.044094    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-token\") pod \"7a85715d-7ba2-4ff6-ad58-d486ce135088\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") "
Sep 06 10:45:17.044231 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.044184    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-podinfo\") pod \"7a85715d-7ba2-4ff6-ad58-d486ce135088\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") "
Sep 06 10:45:17.044231 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.044211    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-credential-socket\") pod \"7a85715d-7ba2-4ff6-ad58-d486ce135088\" (UID: \"7a85715d-7ba2-4ff6-ad58-d486ce135088\") "
Sep 06 10:45:17.044231 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.044209    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7a85715d-7ba2-4ff6-ad58-d486ce135088" (UID: "7a85715d-7ba2-4ff6-ad58-d486ce135088"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:45:17.044406 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.044307    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a85715d-7ba2-4ff6-ad58-d486ce135088-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7a85715d-7ba2-4ff6-ad58-d486ce135088" (UID: "7a85715d-7ba2-4ff6-ad58-d486ce135088"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:45:17.044617 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.044596    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a85715d-7ba2-4ff6-ad58-d486ce135088-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:45:17.044692 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.044602    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7a85715d-7ba2-4ff6-ad58-d486ce135088" (UID: "7a85715d-7ba2-4ff6-ad58-d486ce135088"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:45:17.044692 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.044621    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:45:17.044692 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.044648    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:45:17.044692 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.044659    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:45:17.045907 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.045879    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7a85715d-7ba2-4ff6-ad58-d486ce135088" (UID: "7a85715d-7ba2-4ff6-ad58-d486ce135088"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:45:17.046034 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.046004    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a85715d-7ba2-4ff6-ad58-d486ce135088-kube-api-access-vmfsf" (OuterVolumeSpecName: "kube-api-access-vmfsf") pod "7a85715d-7ba2-4ff6-ad58-d486ce135088" (UID: "7a85715d-7ba2-4ff6-ad58-d486ce135088"). InnerVolumeSpecName "kube-api-access-vmfsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:45:17.046142 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.046127    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-token" (OuterVolumeSpecName: "istio-token") pod "7a85715d-7ba2-4ff6-ad58-d486ce135088" (UID: "7a85715d-7ba2-4ff6-ad58-d486ce135088"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:45:17.046300 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.046285    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7a85715d-7ba2-4ff6-ad58-d486ce135088" (UID: "7a85715d-7ba2-4ff6-ad58-d486ce135088"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 10:45:17.146213 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.146175    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:45:17.146213 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.146208    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:45:17.146213 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.146218    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:45:17.146490 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.146228    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a85715d-7ba2-4ff6-ad58-d486ce135088-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:45:17.146490 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.146237    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmfsf\" (UniqueName: \"kubernetes.io/projected/7a85715d-7ba2-4ff6-ad58-d486ce135088-kube-api-access-vmfsf\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:45:17.742406 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.742354    2561 generic.go:356] "Generic (PLEG): container finished" podID="7a85715d-7ba2-4ff6-ad58-d486ce135088" containerID="b216bef472cacd038f2af308724f7b7441f7fb036fd7627ab4bf76390c956a2a" exitCode=0
Sep 06 10:45:17.742625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.742460    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"
Sep 06 10:45:17.742625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.742475    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl" event={"ID":"7a85715d-7ba2-4ff6-ad58-d486ce135088","Type":"ContainerDied","Data":"b216bef472cacd038f2af308724f7b7441f7fb036fd7627ab4bf76390c956a2a"}
Sep 06 10:45:17.742625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.742531    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl" event={"ID":"7a85715d-7ba2-4ff6-ad58-d486ce135088","Type":"ContainerDied","Data":"ff6c1d02e4f7dc97c139df2d3357aaac719e046f0cabb8397dd2cb59de1471fd"}
Sep 06 10:45:17.742625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.742560    2561 scope.go:117] "RemoveContainer" containerID="b216bef472cacd038f2af308724f7b7441f7fb036fd7627ab4bf76390c956a2a"
Sep 06 10:45:17.753918 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.753898    2561 scope.go:117] "RemoveContainer" containerID="9e87cfbc2800fb434ba44523670ecac989ad113f90e9378e6b423b93263a9e01"
Sep 06 10:45:17.764097 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.764052    2561 scope.go:117] "RemoveContainer" containerID="b216bef472cacd038f2af308724f7b7441f7fb036fd7627ab4bf76390c956a2a"
Sep 06 10:45:17.764459 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:45:17.764435    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b216bef472cacd038f2af308724f7b7441f7fb036fd7627ab4bf76390c956a2a\": container with ID starting with b216bef472cacd038f2af308724f7b7441f7fb036fd7627ab4bf76390c956a2a not found: ID does not exist" containerID="b216bef472cacd038f2af308724f7b7441f7fb036fd7627ab4bf76390c956a2a"
Sep 06 10:45:17.764548 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.764466    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b216bef472cacd038f2af308724f7b7441f7fb036fd7627ab4bf76390c956a2a"} err="failed to get container status \"b216bef472cacd038f2af308724f7b7441f7fb036fd7627ab4bf76390c956a2a\": rpc error: code = NotFound desc = could not find container \"b216bef472cacd038f2af308724f7b7441f7fb036fd7627ab4bf76390c956a2a\": container with ID starting with b216bef472cacd038f2af308724f7b7441f7fb036fd7627ab4bf76390c956a2a not found: ID does not exist"
Sep 06 10:45:17.764548 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.764486    2561 scope.go:117] "RemoveContainer" containerID="9e87cfbc2800fb434ba44523670ecac989ad113f90e9378e6b423b93263a9e01"
Sep 06 10:45:17.764805 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:45:17.764786    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e87cfbc2800fb434ba44523670ecac989ad113f90e9378e6b423b93263a9e01\": container with ID starting with 9e87cfbc2800fb434ba44523670ecac989ad113f90e9378e6b423b93263a9e01 not found: ID does not exist" containerID="9e87cfbc2800fb434ba44523670ecac989ad113f90e9378e6b423b93263a9e01"
Sep 06 10:45:17.764914 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.764810    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e87cfbc2800fb434ba44523670ecac989ad113f90e9378e6b423b93263a9e01"} err="failed to get container status \"9e87cfbc2800fb434ba44523670ecac989ad113f90e9378e6b423b93263a9e01\": rpc error: code = NotFound desc = could not find container \"9e87cfbc2800fb434ba44523670ecac989ad113f90e9378e6b423b93263a9e01\": container with ID starting with 9e87cfbc2800fb434ba44523670ecac989ad113f90e9378e6b423b93263a9e01 not found: ID does not exist"
Sep 06 10:45:17.768790 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.768766    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"]
Sep 06 10:45:17.772767 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:17.772746    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-71e210-openshift-default-5947789984-mblbl"]
Sep 06 10:45:18.754563 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:18.754529    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a85715d-7ba2-4ff6-ad58-d486ce135088" path="/var/lib/kubelet/pods/7a85715d-7ba2-4ff6-ad58-d486ce135088/volumes"
Sep 06 10:45:30.393991 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:30.393953    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:45:30.446425 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:30.446390    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:45:31.825935 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:31.825902    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:45:39.996714 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:39.996681    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:45:49.130638 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:49.130558    2561 scope.go:117] "RemoveContainer" containerID="87d54215f9e81b8663826b7b329a7fd272dd0e0a3b3e3736ad9f3b0dd9b2e49d"
Sep 06 10:45:49.139898 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:45:49.139878    2561 scope.go:117] "RemoveContainer" containerID="2560ca4b6e7d5e4504a0409a8773706b263777c3ca25d32829ce8c23094c135d"
Sep 06 10:46:14.861013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:14.860983    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:15.822963 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:15.822935    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:16.249072 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.249039    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:16.520359 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.520253    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"]
Sep 06 10:46:16.520794 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.520775    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a85715d-7ba2-4ff6-ad58-d486ce135088" containerName="istio-proxy"
Sep 06 10:46:16.520900 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.520796    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a85715d-7ba2-4ff6-ad58-d486ce135088" containerName="istio-proxy"
Sep 06 10:46:16.520900 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.520807    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="608e5ada-ff04-4f82-91a1-40b242cf9b83" containerName="cleanup"
Sep 06 10:46:16.520900 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.520815    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="608e5ada-ff04-4f82-91a1-40b242cf9b83" containerName="cleanup"
Sep 06 10:46:16.520900 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.520825    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be08dde7-88ef-4d33-92c8-346d38adc436" containerName="cleanup"
Sep 06 10:46:16.520900 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.520834    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="be08dde7-88ef-4d33-92c8-346d38adc436" containerName="cleanup"
Sep 06 10:46:16.520900 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.520861    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a85715d-7ba2-4ff6-ad58-d486ce135088" containerName="istio-proxy"
Sep 06 10:46:16.520900 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.520868    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a85715d-7ba2-4ff6-ad58-d486ce135088" containerName="istio-proxy"
Sep 06 10:46:16.520900 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.520877    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94040711-644f-46d5-bfb9-0273168c4f5a" containerName="cleanup"
Sep 06 10:46:16.520900 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.520884    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="94040711-644f-46d5-bfb9-0273168c4f5a" containerName="cleanup"
Sep 06 10:46:16.521415 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.520998    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a85715d-7ba2-4ff6-ad58-d486ce135088" containerName="istio-proxy"
Sep 06 10:46:16.521415 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.521009    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="94040711-644f-46d5-bfb9-0273168c4f5a" containerName="cleanup"
Sep 06 10:46:16.521415 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.521021    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="608e5ada-ff04-4f82-91a1-40b242cf9b83" containerName="cleanup"
Sep 06 10:46:16.521415 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.521035    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a85715d-7ba2-4ff6-ad58-d486ce135088" containerName="istio-proxy"
Sep 06 10:46:16.521415 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.521045    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="be08dde7-88ef-4d33-92c8-346d38adc436" containerName="cleanup"
Sep 06 10:46:16.525964 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.525943    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.528477 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.528446    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-7d2fed-openshift-default-dockercfg-nh52v\""
Sep 06 10:46:16.539216 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.539189    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"]
Sep 06 10:46:16.548775 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.548750    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:16.612757 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.612715    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-workload-socket\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.612933 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.612765    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-data\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.612933 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.612795    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-token\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.612933 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.612852    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjdhd\" (UniqueName: \"kubernetes.io/projected/315d6173-d4c1-4390-983e-ce7aff5671b7-kube-api-access-xjdhd\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.612933 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.612899    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-workload-certs\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.613175 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.612950    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-podinfo\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.613175 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.612984    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-credential-socket\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.613175 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.613006    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/315d6173-d4c1-4390-983e-ce7aff5671b7-istiod-ca-cert\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.613175 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.613085    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-envoy\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.714461 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.714415    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-envoy\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.714667 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.714481    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-workload-socket\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.714667 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.714507    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-data\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.714667 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.714534    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-token\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.714667 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.714555    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjdhd\" (UniqueName: \"kubernetes.io/projected/315d6173-d4c1-4390-983e-ce7aff5671b7-kube-api-access-xjdhd\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.714667 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.714590    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-workload-certs\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.714667 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.714649    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-podinfo\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.714888 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.714694    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-credential-socket\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.714888 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.714727    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/315d6173-d4c1-4390-983e-ce7aff5671b7-istiod-ca-cert\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.714888 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.714864    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-workload-socket\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.715072 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.714924    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-data\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.715167 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.715138    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-workload-certs\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.715230 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.715205    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-credential-socket\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.715514 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.715496    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/315d6173-d4c1-4390-983e-ce7aff5671b7-istiod-ca-cert\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.716945 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.716920    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-envoy\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.717047 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.717013    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-podinfo\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.728255 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.728235    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-token\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.728396 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.728256    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjdhd\" (UniqueName: \"kubernetes.io/projected/315d6173-d4c1-4390-983e-ce7aff5671b7-kube-api-access-xjdhd\") pod \"e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") " pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:16.838256 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:16.838184    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:17.048400 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:17.048373    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:17.114458 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:17.114434    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"]
Sep 06 10:46:17.115805 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:46:17.115777    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod315d6173_d4c1_4390_983e_ce7aff5671b7.slice/crio-2493dbfa466ca1f91b0bc7e0273a4677165226d771d496f98187f1a0ce640bff WatchSource:0}: Error finding container 2493dbfa466ca1f91b0bc7e0273a4677165226d771d496f98187f1a0ce640bff: Status 404 returned error can't find the container with id 2493dbfa466ca1f91b0bc7e0273a4677165226d771d496f98187f1a0ce640bff
Sep 06 10:46:17.117873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:17.117839    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:46:17.117959 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:17.117896    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:46:17.117959 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:17.117927    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:46:18.120856 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:18.120820    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9" event={"ID":"315d6173-d4c1-4390-983e-ce7aff5671b7","Type":"ContainerStarted","Data":"3a848d5f216b0b4c5ec0fed1b124b8689fdde83e1435e62f9f71beaf5962a047"}
Sep 06 10:46:18.121235 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:18.120882    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9" event={"ID":"315d6173-d4c1-4390-983e-ce7aff5671b7","Type":"ContainerStarted","Data":"2493dbfa466ca1f91b0bc7e0273a4677165226d771d496f98187f1a0ce640bff"}
Sep 06 10:46:18.141139 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:18.141092    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9" podStartSLOduration=2.141077138 podStartE2EDuration="2.141077138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:46:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:46:18.138669306 +0000 UTC m=+1469.917088719" watchObservedRunningTime="2026-09-06 10:46:18.141077138 +0000 UTC m=+1469.919496551"
Sep 06 10:46:18.838791 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:18.838761    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:18.843454 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:18.843427    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:19.127657 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:19.127572    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:19.128661 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:19.128634    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:20.044403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:20.044365    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:20.142872 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:20.142838    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:21.274685 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:21.274649    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:21.375086 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:21.375052    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:21.560384 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:21.560272    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:21.733144 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:21.733110    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:21.833209 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:21.833136    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:35.169491 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:35.169446    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 10:46:35.169899 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:35.169527    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9" podUID="315d6173-d4c1-4390-983e-ce7aff5671b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 10:46:37.248114 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:37.248028    2561 generic.go:356] "Generic (PLEG): container finished" podID="315d6173-d4c1-4390-983e-ce7aff5671b7" containerID="3a848d5f216b0b4c5ec0fed1b124b8689fdde83e1435e62f9f71beaf5962a047" exitCode=0
Sep 06 10:46:37.248585 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:37.248101    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9" event={"ID":"315d6173-d4c1-4390-983e-ce7aff5671b7","Type":"ContainerDied","Data":"3a848d5f216b0b4c5ec0fed1b124b8689fdde83e1435e62f9f71beaf5962a047"}
Sep 06 10:46:37.248585 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:37.248536    2561 scope.go:117] "RemoveContainer" containerID="3a848d5f216b0b4c5ec0fed1b124b8689fdde83e1435e62f9f71beaf5962a047"
Sep 06 10:46:37.249644 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:37.249612    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:46:37.249734 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:37.249681    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:46:37.249734 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:37.249715    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:46:38.257461 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:38.257422    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9" event={"ID":"315d6173-d4c1-4390-983e-ce7aff5671b7","Type":"ContainerStarted","Data":"9dfd000ec4ab85e22476db60e2df238a9993ab12026d4122fc14d90f98926854"}
Sep 06 10:46:38.839371 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:38.839312    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:38.839588 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:38.839391    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 06 10:46:38.839588 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:38.839456    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9" podUID="315d6173-d4c1-4390-983e-ce7aff5671b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 06 10:46:39.839020 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:39.838974    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 06 10:46:39.839542 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:39.839051    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9" podUID="315d6173-d4c1-4390-983e-ce7aff5671b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 06 10:46:40.839316 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:40.839275    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 06 10:46:40.839945 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:40.839910    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9" podUID="315d6173-d4c1-4390-983e-ce7aff5671b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 06 10:46:41.839469 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:41.839424    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 06 10:46:41.840075 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:41.840036    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9" podUID="315d6173-d4c1-4390-983e-ce7aff5671b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 06 10:46:42.839535 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:42.839497    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 06 10:46:42.840108 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:42.840076    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9" podUID="315d6173-d4c1-4390-983e-ce7aff5671b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 06 10:46:43.839303 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:43.839264    2561 patch_prober.go:28] interesting pod/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Sep 06 10:46:43.839526 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:43.839403    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9" podUID="315d6173-d4c1-4390-983e-ce7aff5671b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Sep 06 10:46:44.842181 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:44.842152    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:44.842590 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:44.842527    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:44.843065 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:44.843048    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:46:45.711428 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:45.711393    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:45.765805 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:45.765777    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:46.024743 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.024658    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"]
Sep 06 10:46:46.027630 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.027610    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.031380 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.031359    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-5be549-openshift-default-dockercfg-8x42c\""
Sep 06 10:46:46.044313 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.044287    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"]
Sep 06 10:46:46.065432 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.065405    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:46.130618 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.130580    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-data\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.130867 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.130649    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-envoy\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.130867 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.130689    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jlln\" (UniqueName: \"kubernetes.io/projected/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-kube-api-access-7jlln\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.130867 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.130723    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-token\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.130867 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.130749    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-podinfo\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.130867 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.130779    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istiod-ca-cert\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.130867 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.130843    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-workload-socket\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.131218 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.130887    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-workload-certs\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.131218 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.130922    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-credential-socket\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.231952 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.231913    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-credential-socket\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.232108 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.231985    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-data\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.232108 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.232032    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-envoy\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.232108 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.232064    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jlln\" (UniqueName: \"kubernetes.io/projected/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-kube-api-access-7jlln\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.232108 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.232098    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-token\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.232348 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.232121    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-podinfo\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.232348 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.232164    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istiod-ca-cert\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.232348 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.232223    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-workload-socket\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.232348 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.232266    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-workload-certs\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.232573 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.232514    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-data\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.232629 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.232605    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-workload-certs\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.232720 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.232702    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-credential-socket\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.232780 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.232729    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-workload-socket\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.233072 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.233048    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istiod-ca-cert\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.234532 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.234513    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-envoy\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.234660 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.234643    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-podinfo\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.240467 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.240439    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-token\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.240558 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.240511    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jlln\" (UniqueName: \"kubernetes.io/projected/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-kube-api-access-7jlln\") pod \"e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") " pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.314607 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.314534    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:46.338851 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.338828    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:46.619530 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.619498    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"]
Sep 06 10:46:46.620074 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:46:46.620052    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e28ec36_27c8_4e46_a688_5e4b951d9cc2.slice/crio-a1b8b9a7eea956c2e0a7f1921d2ff75b6ac54c16552f393a56b5c5005e1b3234 WatchSource:0}: Error finding container a1b8b9a7eea956c2e0a7f1921d2ff75b6ac54c16552f393a56b5c5005e1b3234: Status 404 returned error can't find the container with id a1b8b9a7eea956c2e0a7f1921d2ff75b6ac54c16552f393a56b5c5005e1b3234
Sep 06 10:46:46.622376 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.622342    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:46:46.622479 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.622406    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:46:46.622479 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:46.622436    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:46:47.319616 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:47.319578    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk" event={"ID":"6e28ec36-27c8-4e46-a688-5e4b951d9cc2","Type":"ContainerStarted","Data":"c40d43932cbcfed324f91556b9c7e5807ed78b311d3249d6d47ba64939f72d6d"}
Sep 06 10:46:47.320010 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:47.319640    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk" event={"ID":"6e28ec36-27c8-4e46-a688-5e4b951d9cc2","Type":"ContainerStarted","Data":"a1b8b9a7eea956c2e0a7f1921d2ff75b6ac54c16552f393a56b5c5005e1b3234"}
Sep 06 10:46:47.339527 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:47.339498    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:47.341625 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:47.341582    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk" podStartSLOduration=1.341567159 podStartE2EDuration="1.341567159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:46:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:46:47.337738989 +0000 UTC m=+1499.116158405" watchObservedRunningTime="2026-09-06 10:46:47.341567159 +0000 UTC m=+1499.119986573"
Sep 06 10:46:47.345553 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:47.345530    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:48.325993 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:48.325964    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:48.327050 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:48.327028    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:46:48.834755 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:48.834724    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/1.log"
Sep 06 10:46:48.838470 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:48.838449    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/1.log"
Sep 06 10:46:48.839514 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:48.839495    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsw6t_a4733769-37b3-443b-9ee5-d93bd5f167f0/ovn-acl-logging/0.log"
Sep 06 10:46:48.843213 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:48.843195    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsw6t_a4733769-37b3-443b-9ee5-d93bd5f167f0/ovn-acl-logging/0.log"
Sep 06 10:46:49.239622 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:49.239588    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:49.339225 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:49.339193    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:50.406940 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:50.406913    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:50.508598 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:50.508566    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:50.845429 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:50.845344    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:50.945137 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:50.945108    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:46:51.031113 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:46:51.031084    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:47:07.446397 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:07.446361    2561 generic.go:356] "Generic (PLEG): container finished" podID="6e28ec36-27c8-4e46-a688-5e4b951d9cc2" containerID="c40d43932cbcfed324f91556b9c7e5807ed78b311d3249d6d47ba64939f72d6d" exitCode=0
Sep 06 10:47:07.446812 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:07.446432    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk" event={"ID":"6e28ec36-27c8-4e46-a688-5e4b951d9cc2","Type":"ContainerDied","Data":"c40d43932cbcfed324f91556b9c7e5807ed78b311d3249d6d47ba64939f72d6d"}
Sep 06 10:47:07.446858 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:07.446833    2561 scope.go:117] "RemoveContainer" containerID="c40d43932cbcfed324f91556b9c7e5807ed78b311d3249d6d47ba64939f72d6d"
Sep 06 10:47:07.447909 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:07.447870    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:47:07.448004 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:07.447971    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:47:07.448067 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:07.448018    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:47:08.459790 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:08.459739    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk" event={"ID":"6e28ec36-27c8-4e46-a688-5e4b951d9cc2","Type":"ContainerStarted","Data":"d7d1e60af1ebcaf825344540c16d9814b9c4ed55a4aceb8361ed71aebbb6ebf1"}
Sep 06 10:47:09.339344 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:09.339287    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:47:09.339567 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:09.339395    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused" start-of-body=
Sep 06 10:47:09.339567 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:09.339465    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk" podUID="6e28ec36-27c8-4e46-a688-5e4b951d9cc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused"
Sep 06 10:47:10.348345 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:10.339838    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused" start-of-body=
Sep 06 10:47:10.348345 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:10.339896    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk" podUID="6e28ec36-27c8-4e46-a688-5e4b951d9cc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused"
Sep 06 10:47:11.339665 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:11.339571    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused" start-of-body=
Sep 06 10:47:11.339665 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:11.339639    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk" podUID="6e28ec36-27c8-4e46-a688-5e4b951d9cc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused"
Sep 06 10:47:12.339648 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:12.339595    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused" start-of-body=
Sep 06 10:47:12.340299 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:12.339685    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk" podUID="6e28ec36-27c8-4e46-a688-5e4b951d9cc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused"
Sep 06 10:47:13.339716 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:13.339670    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused" start-of-body=
Sep 06 10:47:13.340238 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:13.339766    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk" podUID="6e28ec36-27c8-4e46-a688-5e4b951d9cc2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.95:15021/healthz/ready\": dial tcp 10.133.0.95:15021: connect: connection refused"
Sep 06 10:47:14.280771 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:14.280737    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:47:14.344072 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:14.344042    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:47:14.344485 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:14.344359    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:47:14.344968 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:14.344952    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:47:19.355163 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:19.355128    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-gsbqz_da70f3cc-515f-40f9-83fe-ac247b59d6c2/payload-processing/0.log"
Sep 06 10:47:33.019652 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:33.019597    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:47:49.187526 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:49.187491    2561 scope.go:117] "RemoveContainer" containerID="c75262446abe8b5c3c121e9c2dd04f893fa6ff9e62afe3ae3ed09a8d22958718"
Sep 06 10:47:50.077729 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:50.077695    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:47:50.133728 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:50.133697    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:47:59.493688 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:59.493655    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-gsbqz_da70f3cc-515f-40f9-83fe-ac247b59d6c2/payload-processing/0.log"
Sep 06 10:47:59.885982 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:47:59.885903    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:00.171721 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.171689    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"]
Sep 06 10:48:00.175265 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.175247    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.177515 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.177498    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-622573-openshift-default-dockercfg-wwwkc\""
Sep 06 10:48:00.183898 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.183872    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"]
Sep 06 10:48:00.255618 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.255582    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pw6k\" (UniqueName: \"kubernetes.io/projected/6ec84614-0676-4ed6-a20e-1a42465f6842-kube-api-access-5pw6k\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.255782 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.255625    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-data\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.255782 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.255742    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-podinfo\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.255861 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.255788    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-credential-socket\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.255861 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.255834    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ec84614-0676-4ed6-a20e-1a42465f6842-istiod-ca-cert\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.255931 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.255871    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-token\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.255931 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.255891    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-workload-socket\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.255931 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.255916    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-envoy\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.256026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.255935    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-workload-certs\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.356820 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.356783    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pw6k\" (UniqueName: \"kubernetes.io/projected/6ec84614-0676-4ed6-a20e-1a42465f6842-kube-api-access-5pw6k\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.356820 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.356826    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-data\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.357052 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.356880    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-podinfo\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.357052 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.356903    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-credential-socket\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.357052 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.356934    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ec84614-0676-4ed6-a20e-1a42465f6842-istiod-ca-cert\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.357052 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.356973    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-token\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.357052 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.357006    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-workload-socket\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.357052 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.357041    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-envoy\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.357403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.357069    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-workload-certs\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.357403 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.357377    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-data\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.357519 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.357402    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-credential-socket\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.357519 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.357485    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-workload-socket\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.357627 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.357528    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-workload-certs\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.357889 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.357866    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ec84614-0676-4ed6-a20e-1a42465f6842-istiod-ca-cert\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.359463 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.359436    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-envoy\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.359594 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.359576    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-podinfo\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.364429 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.364403    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-token\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.364514 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.364411    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pw6k\" (UniqueName: \"kubernetes.io/projected/6ec84614-0676-4ed6-a20e-1a42465f6842-kube-api-access-5pw6k\") pod \"e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") " pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.487613 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.487520    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:00.763351 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.763312    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"]
Sep 06 10:48:00.764881 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:48:00.764844    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec84614_0676_4ed6_a20e_1a42465f6842.slice/crio-96c06ec5b6148041bbf31f24cbad8addd26593ee5d6506dcc902a80783187168 WatchSource:0}: Error finding container 96c06ec5b6148041bbf31f24cbad8addd26593ee5d6506dcc902a80783187168: Status 404 returned error can't find the container with id 96c06ec5b6148041bbf31f24cbad8addd26593ee5d6506dcc902a80783187168
Sep 06 10:48:00.767654 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.767613    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:48:00.767803 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.767780    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:48:00.767911 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.767835    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:48:00.785009 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:00.784977    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f" event={"ID":"6ec84614-0676-4ed6-a20e-1a42465f6842","Type":"ContainerStarted","Data":"96c06ec5b6148041bbf31f24cbad8addd26593ee5d6506dcc902a80783187168"}
Sep 06 10:48:01.275510 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:01.275471    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:01.792904 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:01.792868    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f" event={"ID":"6ec84614-0676-4ed6-a20e-1a42465f6842","Type":"ContainerStarted","Data":"e73c17906752da08b1c3039e66e58f02c699d209039c98bf1dc25f59a91c8b6f"}
Sep 06 10:48:01.813660 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:01.813606    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f" podStartSLOduration=1.813590104 podStartE2EDuration="1.813590104s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:48:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:48:01.812512358 +0000 UTC m=+1573.590931773" watchObservedRunningTime="2026-09-06 10:48:01.813590104 +0000 UTC m=+1573.592009517"
Sep 06 10:48:02.488435 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:02.488401    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:02.493868 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:02.493842    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:02.800941 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:02.800850    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:02.801817 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:02.801790    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:03.736656 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:03.736619    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:03.846695 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:03.846669    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:04.874978 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:04.874950    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:04.984601 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:04.984550    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:05.074979 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:05.074949    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:05.346972 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:05.346938    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:05.446867 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:05.446837    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:18.842448 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:18.842413    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 10:48:18.842873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:18.842462    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f" podUID="6ec84614-0676-4ed6-a20e-1a42465f6842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 10:48:20.923988 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:20.923953    2561 generic.go:356] "Generic (PLEG): container finished" podID="6ec84614-0676-4ed6-a20e-1a42465f6842" containerID="e73c17906752da08b1c3039e66e58f02c699d209039c98bf1dc25f59a91c8b6f" exitCode=0
Sep 06 10:48:20.924450 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:20.924025    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f" event={"ID":"6ec84614-0676-4ed6-a20e-1a42465f6842","Type":"ContainerDied","Data":"e73c17906752da08b1c3039e66e58f02c699d209039c98bf1dc25f59a91c8b6f"}
Sep 06 10:48:20.924503 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:20.924475    2561 scope.go:117] "RemoveContainer" containerID="e73c17906752da08b1c3039e66e58f02c699d209039c98bf1dc25f59a91c8b6f"
Sep 06 10:48:20.926812 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:20.926162    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:48:20.926812 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:20.926342    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:48:20.926812 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:20.926442    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 06 10:48:21.932475 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:21.932443    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f" event={"ID":"6ec84614-0676-4ed6-a20e-1a42465f6842","Type":"ContainerStarted","Data":"f0a41101e1626851c0084b2e7dc5e6e98113924eb8991fa260b17d64b3999419"}
Sep 06 10:48:22.488734 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:22.488692    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:22.488926 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:22.488902    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Sep 06 10:48:22.488995 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:22.488964    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f" podUID="6ec84614-0676-4ed6-a20e-1a42465f6842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Sep 06 10:48:23.488481 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:23.488447    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Sep 06 10:48:23.488866 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:23.488500    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f" podUID="6ec84614-0676-4ed6-a20e-1a42465f6842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Sep 06 10:48:24.488204 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:24.488170    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Sep 06 10:48:24.488395 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:24.488225    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f" podUID="6ec84614-0676-4ed6-a20e-1a42465f6842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Sep 06 10:48:25.488654 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:25.488617    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Sep 06 10:48:25.489035 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:25.488667    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f" podUID="6ec84614-0676-4ed6-a20e-1a42465f6842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Sep 06 10:48:26.487973 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:26.487935    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused" start-of-body=
Sep 06 10:48:26.488157 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:26.488011    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f" podUID="6ec84614-0676-4ed6-a20e-1a42465f6842" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.96:15021/healthz/ready\": dial tcp 10.133.0.96:15021: connect: connection refused"
Sep 06 10:48:27.679676 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:27.679643    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:27.680143 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:27.680033    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:27.680985 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:27.680930    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:28.768598 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:28.768567    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:29.447558 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:29.447524    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-622573-qglcl"]
Sep 06 10:48:29.450331 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:29.450308    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-622573-qglcl"
Sep 06 10:48:29.452586 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:29.452564    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n5b2f\""
Sep 06 10:48:29.459148 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:29.459125    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-622573-qglcl"]
Sep 06 10:48:29.558346 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:29.558288    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0350c074-4fc2-4269-9af3-ca400b611514-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-622573-qglcl\" (UID: \"0350c074-4fc2-4269-9af3-ca400b611514\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-622573-qglcl"
Sep 06 10:48:29.659789 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:29.659752    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0350c074-4fc2-4269-9af3-ca400b611514-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-622573-qglcl\" (UID: \"0350c074-4fc2-4269-9af3-ca400b611514\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-622573-qglcl"
Sep 06 10:48:29.660419 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:29.660398    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0350c074-4fc2-4269-9af3-ca400b611514-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-622573-qglcl\" (UID: \"0350c074-4fc2-4269-9af3-ca400b611514\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-622573-qglcl"
Sep 06 10:48:29.763046 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:29.762964    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-622573-qglcl"
Sep 06 10:48:30.033001 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:30.032977    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-622573-qglcl"]
Sep 06 10:48:30.034815 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:48:30.034790    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0350c074_4fc2_4269_9af3_ca400b611514.slice/crio-61dd9b6bf588c3a288313db62e404d5803286839561223d5d2a43f27cf567bc2 WatchSource:0}: Error finding container 61dd9b6bf588c3a288313db62e404d5803286839561223d5d2a43f27cf567bc2: Status 404 returned error can't find the container with id 61dd9b6bf588c3a288313db62e404d5803286839561223d5d2a43f27cf567bc2
Sep 06 10:48:31.017571 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:31.017480    2561 generic.go:356] "Generic (PLEG): container finished" podID="0350c074-4fc2-4269-9af3-ca400b611514" containerID="876557295e57bce18867d297f2d5338d113a984b8f8d68b8a7447e669cfa7253" exitCode=0
Sep 06 10:48:31.017717 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:31.017565    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-622573-qglcl" event={"ID":"0350c074-4fc2-4269-9af3-ca400b611514","Type":"ContainerDied","Data":"876557295e57bce18867d297f2d5338d113a984b8f8d68b8a7447e669cfa7253"}
Sep 06 10:48:31.017717 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:31.017639    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-622573-qglcl" event={"ID":"0350c074-4fc2-4269-9af3-ca400b611514","Type":"ContainerStarted","Data":"61dd9b6bf588c3a288313db62e404d5803286839561223d5d2a43f27cf567bc2"}
Sep 06 10:48:32.158929 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:32.158902    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-622573-qglcl"
Sep 06 10:48:32.186018 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:32.185989    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0350c074-4fc2-4269-9af3-ca400b611514-maas-api-service-ca\") pod \"0350c074-4fc2-4269-9af3-ca400b611514\" (UID: \"0350c074-4fc2-4269-9af3-ca400b611514\") "
Sep 06 10:48:32.186417 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:32.186390    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0350c074-4fc2-4269-9af3-ca400b611514-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0350c074-4fc2-4269-9af3-ca400b611514" (UID: "0350c074-4fc2-4269-9af3-ca400b611514"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:48:32.287448 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:32.287372    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0350c074-4fc2-4269-9af3-ca400b611514-maas-api-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:48:33.031201 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:33.031124    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-622573-qglcl"
Sep 06 10:48:33.031372 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:33.031123    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-622573-qglcl" event={"ID":"0350c074-4fc2-4269-9af3-ca400b611514","Type":"ContainerDied","Data":"61dd9b6bf588c3a288313db62e404d5803286839561223d5d2a43f27cf567bc2"}
Sep 06 10:48:33.031372 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:33.031246    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61dd9b6bf588c3a288313db62e404d5803286839561223d5d2a43f27cf567bc2"
Sep 06 10:48:35.364048 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:35.364017    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:35.425652 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:35.425613    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:35.486391 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:35.486343    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:35.555555 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:35.555528    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-622573-qglcl"]
Sep 06 10:48:35.556873 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:35.556847    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:35.558495 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:35.558474    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-622573-qglcl"]
Sep 06 10:48:35.620470 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:35.620407    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:35.931881 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:35.931847    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:36.754986 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:36.754948    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0350c074-4fc2-4269-9af3-ca400b611514" path="/var/lib/kubelet/pods/0350c074-4fc2-4269-9af3-ca400b611514/volumes"
Sep 06 10:48:41.587468 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:41.587385    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:41.686581 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:41.686541    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:41.834848 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:41.834815    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"]
Sep 06 10:48:41.835076 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:41.835050    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f" podUID="6ec84614-0676-4ed6-a20e-1a42465f6842" containerName="istio-proxy" containerID="cri-o://f0a41101e1626851c0084b2e7dc5e6e98113924eb8991fa260b17d64b3999419" gracePeriod=30
Sep 06 10:48:41.848875 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:41.848784    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:42.682661 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:42.682615    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 06 10:48:42.683040 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:42.682704    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f" podUID="6ec84614-0676-4ed6-a20e-1a42465f6842" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 10:48:45.476718 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:45.476685    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7d2fed-86447"]
Sep 06 10:48:45.477113 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:45.477101    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0350c074-4fc2-4269-9af3-ca400b611514" containerName="revoke-keys"
Sep 06 10:48:45.477159 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:45.477114    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0350c074-4fc2-4269-9af3-ca400b611514" containerName="revoke-keys"
Sep 06 10:48:45.477207 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:45.477199    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0350c074-4fc2-4269-9af3-ca400b611514" containerName="revoke-keys"
Sep 06 10:48:45.479695 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:45.479678    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7d2fed-86447"
Sep 06 10:48:45.482254 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:45.482232    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n5b2f\""
Sep 06 10:48:45.489083 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:45.489062    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7d2fed-86447"]
Sep 06 10:48:45.628412 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:45.628380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcc11279-943c-40fb-a8f8-3bff91c91441-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-7d2fed-86447\" (UID: \"dcc11279-943c-40fb-a8f8-3bff91c91441\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7d2fed-86447"
Sep 06 10:48:45.713398 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:45.713366    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:45.729890 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:45.729824    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcc11279-943c-40fb-a8f8-3bff91c91441-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-7d2fed-86447\" (UID: \"dcc11279-943c-40fb-a8f8-3bff91c91441\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7d2fed-86447"
Sep 06 10:48:45.730484 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:45.730461    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcc11279-943c-40fb-a8f8-3bff91c91441-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-7d2fed-86447\" (UID: \"dcc11279-943c-40fb-a8f8-3bff91c91441\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7d2fed-86447"
Sep 06 10:48:45.791434 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:45.791400    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7d2fed-86447"
Sep 06 10:48:46.065436 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:46.065408    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7d2fed-86447"]
Sep 06 10:48:46.066876 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:48:46.066853    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcc11279_943c_40fb_a8f8_3bff91c91441.slice/crio-cc60708cdcd045fa12f7b45eefac75aaf6269361ff2950ce542efb4324c00a7b WatchSource:0}: Error finding container cc60708cdcd045fa12f7b45eefac75aaf6269361ff2950ce542efb4324c00a7b: Status 404 returned error can't find the container with id cc60708cdcd045fa12f7b45eefac75aaf6269361ff2950ce542efb4324c00a7b
Sep 06 10:48:46.114804 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:46.114779    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7d2fed-86447" event={"ID":"dcc11279-943c-40fb-a8f8-3bff91c91441","Type":"ContainerStarted","Data":"cc60708cdcd045fa12f7b45eefac75aaf6269361ff2950ce542efb4324c00a7b"}
Sep 06 10:48:47.090912 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.090888    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:47.134000 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.133955    2561 generic.go:356] "Generic (PLEG): container finished" podID="6ec84614-0676-4ed6-a20e-1a42465f6842" containerID="f0a41101e1626851c0084b2e7dc5e6e98113924eb8991fa260b17d64b3999419" exitCode=0
Sep 06 10:48:47.134181 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.134030    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"
Sep 06 10:48:47.134181 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.134028    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f" event={"ID":"6ec84614-0676-4ed6-a20e-1a42465f6842","Type":"ContainerDied","Data":"f0a41101e1626851c0084b2e7dc5e6e98113924eb8991fa260b17d64b3999419"}
Sep 06 10:48:47.134181 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.134106    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f" event={"ID":"6ec84614-0676-4ed6-a20e-1a42465f6842","Type":"ContainerDied","Data":"96c06ec5b6148041bbf31f24cbad8addd26593ee5d6506dcc902a80783187168"}
Sep 06 10:48:47.134181 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.134134    2561 scope.go:117] "RemoveContainer" containerID="f0a41101e1626851c0084b2e7dc5e6e98113924eb8991fa260b17d64b3999419"
Sep 06 10:48:47.135893 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.135863    2561 generic.go:356] "Generic (PLEG): container finished" podID="dcc11279-943c-40fb-a8f8-3bff91c91441" containerID="a5a60f1aaab1691bc7597ab1af1092ccaa0cb8bcba93a0526a8822c3c6b2b8cb" exitCode=0
Sep 06 10:48:47.136007 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.135946    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7d2fed-86447" event={"ID":"dcc11279-943c-40fb-a8f8-3bff91c91441","Type":"ContainerDied","Data":"a5a60f1aaab1691bc7597ab1af1092ccaa0cb8bcba93a0526a8822c3c6b2b8cb"}
Sep 06 10:48:47.144641 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.144621    2561 scope.go:117] "RemoveContainer" containerID="e73c17906752da08b1c3039e66e58f02c699d209039c98bf1dc25f59a91c8b6f"
Sep 06 10:48:47.156855 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.156832    2561 scope.go:117] "RemoveContainer" containerID="f0a41101e1626851c0084b2e7dc5e6e98113924eb8991fa260b17d64b3999419"
Sep 06 10:48:47.157399 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:48:47.157375    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0a41101e1626851c0084b2e7dc5e6e98113924eb8991fa260b17d64b3999419\": container with ID starting with f0a41101e1626851c0084b2e7dc5e6e98113924eb8991fa260b17d64b3999419 not found: ID does not exist" containerID="f0a41101e1626851c0084b2e7dc5e6e98113924eb8991fa260b17d64b3999419"
Sep 06 10:48:47.157509 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.157406    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0a41101e1626851c0084b2e7dc5e6e98113924eb8991fa260b17d64b3999419"} err="failed to get container status \"f0a41101e1626851c0084b2e7dc5e6e98113924eb8991fa260b17d64b3999419\": rpc error: code = NotFound desc = could not find container \"f0a41101e1626851c0084b2e7dc5e6e98113924eb8991fa260b17d64b3999419\": container with ID starting with f0a41101e1626851c0084b2e7dc5e6e98113924eb8991fa260b17d64b3999419 not found: ID does not exist"
Sep 06 10:48:47.157509 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.157428    2561 scope.go:117] "RemoveContainer" containerID="e73c17906752da08b1c3039e66e58f02c699d209039c98bf1dc25f59a91c8b6f"
Sep 06 10:48:47.157754 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:48:47.157734    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e73c17906752da08b1c3039e66e58f02c699d209039c98bf1dc25f59a91c8b6f\": container with ID starting with e73c17906752da08b1c3039e66e58f02c699d209039c98bf1dc25f59a91c8b6f not found: ID does not exist" containerID="e73c17906752da08b1c3039e66e58f02c699d209039c98bf1dc25f59a91c8b6f"
Sep 06 10:48:47.157853 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.157757    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e73c17906752da08b1c3039e66e58f02c699d209039c98bf1dc25f59a91c8b6f"} err="failed to get container status \"e73c17906752da08b1c3039e66e58f02c699d209039c98bf1dc25f59a91c8b6f\": rpc error: code = NotFound desc = could not find container \"e73c17906752da08b1c3039e66e58f02c699d209039c98bf1dc25f59a91c8b6f\": container with ID starting with e73c17906752da08b1c3039e66e58f02c699d209039c98bf1dc25f59a91c8b6f not found: ID does not exist"
Sep 06 10:48:47.246366 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.246311    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ec84614-0676-4ed6-a20e-1a42465f6842-istiod-ca-cert\") pod \"6ec84614-0676-4ed6-a20e-1a42465f6842\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") "
Sep 06 10:48:47.246366 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.246373    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-envoy\") pod \"6ec84614-0676-4ed6-a20e-1a42465f6842\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") "
Sep 06 10:48:47.246580 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.246402    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-podinfo\") pod \"6ec84614-0676-4ed6-a20e-1a42465f6842\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") "
Sep 06 10:48:47.246580 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.246427    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-credential-socket\") pod \"6ec84614-0676-4ed6-a20e-1a42465f6842\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") "
Sep 06 10:48:47.246580 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.246455    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-token\") pod \"6ec84614-0676-4ed6-a20e-1a42465f6842\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") "
Sep 06 10:48:47.246580 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.246511    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-workload-socket\") pod \"6ec84614-0676-4ed6-a20e-1a42465f6842\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") "
Sep 06 10:48:47.246580 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.246548    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-workload-certs\") pod \"6ec84614-0676-4ed6-a20e-1a42465f6842\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") "
Sep 06 10:48:47.246580 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.246576    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pw6k\" (UniqueName: \"kubernetes.io/projected/6ec84614-0676-4ed6-a20e-1a42465f6842-kube-api-access-5pw6k\") pod \"6ec84614-0676-4ed6-a20e-1a42465f6842\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") "
Sep 06 10:48:47.246864 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.246645    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-data\") pod \"6ec84614-0676-4ed6-a20e-1a42465f6842\" (UID: \"6ec84614-0676-4ed6-a20e-1a42465f6842\") "
Sep 06 10:48:47.246864 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.246726    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ec84614-0676-4ed6-a20e-1a42465f6842-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6ec84614-0676-4ed6-a20e-1a42465f6842" (UID: "6ec84614-0676-4ed6-a20e-1a42465f6842"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:48:47.246986 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.246871    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6ec84614-0676-4ed6-a20e-1a42465f6842" (UID: "6ec84614-0676-4ed6-a20e-1a42465f6842"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:48:47.246986 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.246877    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6ec84614-0676-4ed6-a20e-1a42465f6842" (UID: "6ec84614-0676-4ed6-a20e-1a42465f6842"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:48:47.246986 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.246898    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6ec84614-0676-4ed6-a20e-1a42465f6842" (UID: "6ec84614-0676-4ed6-a20e-1a42465f6842"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:48:47.247145 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.247041    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:48:47.247145 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.247062    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ec84614-0676-4ed6-a20e-1a42465f6842-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:48:47.247145 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.247076    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:48:47.247145 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.247090    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:48:47.247145 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.247042    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-data" (OuterVolumeSpecName: "istio-data") pod "6ec84614-0676-4ed6-a20e-1a42465f6842" (UID: "6ec84614-0676-4ed6-a20e-1a42465f6842"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:48:47.248718 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.248694    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6ec84614-0676-4ed6-a20e-1a42465f6842" (UID: "6ec84614-0676-4ed6-a20e-1a42465f6842"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:48:47.248869 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.248848    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6ec84614-0676-4ed6-a20e-1a42465f6842" (UID: "6ec84614-0676-4ed6-a20e-1a42465f6842"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 10:48:47.248869 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.248864    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ec84614-0676-4ed6-a20e-1a42465f6842-kube-api-access-5pw6k" (OuterVolumeSpecName: "kube-api-access-5pw6k") pod "6ec84614-0676-4ed6-a20e-1a42465f6842" (UID: "6ec84614-0676-4ed6-a20e-1a42465f6842"). InnerVolumeSpecName "kube-api-access-5pw6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:48:47.248946 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.248850    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-token" (OuterVolumeSpecName: "istio-token") pod "6ec84614-0676-4ed6-a20e-1a42465f6842" (UID: "6ec84614-0676-4ed6-a20e-1a42465f6842"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:48:47.347719 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.347691    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:48:47.347719 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.347717    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:48:47.347894 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.347726    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:48:47.347894 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.347735    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pw6k\" (UniqueName: \"kubernetes.io/projected/6ec84614-0676-4ed6-a20e-1a42465f6842-kube-api-access-5pw6k\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:48:47.347894 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.347745    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ec84614-0676-4ed6-a20e-1a42465f6842-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:48:47.458238 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.458208    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"]
Sep 06 10:48:47.463941 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:47.463917    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-622573-openshift-default-87784d7f4-g8l2f"]
Sep 06 10:48:48.301437 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:48.301409    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7d2fed-86447"
Sep 06 10:48:48.458649 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:48.458620    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcc11279-943c-40fb-a8f8-3bff91c91441-maas-api-service-ca\") pod \"dcc11279-943c-40fb-a8f8-3bff91c91441\" (UID: \"dcc11279-943c-40fb-a8f8-3bff91c91441\") "
Sep 06 10:48:48.458963 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:48.458941    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcc11279-943c-40fb-a8f8-3bff91c91441-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dcc11279-943c-40fb-a8f8-3bff91c91441" (UID: "dcc11279-943c-40fb-a8f8-3bff91c91441"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:48:48.560016 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:48.559971    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcc11279-943c-40fb-a8f8-3bff91c91441-maas-api-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:48:48.754721 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:48.754644    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ec84614-0676-4ed6-a20e-1a42465f6842" path="/var/lib/kubelet/pods/6ec84614-0676-4ed6-a20e-1a42465f6842/volumes"
Sep 06 10:48:49.151394 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:49.151308    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7d2fed-86447"
Sep 06 10:48:49.151394 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:49.151352    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7d2fed-86447" event={"ID":"dcc11279-943c-40fb-a8f8-3bff91c91441","Type":"ContainerDied","Data":"cc60708cdcd045fa12f7b45eefac75aaf6269361ff2950ce542efb4324c00a7b"}
Sep 06 10:48:49.151565 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:49.151396    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc60708cdcd045fa12f7b45eefac75aaf6269361ff2950ce542efb4324c00a7b"
Sep 06 10:48:49.213804 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:49.213772    2561 scope.go:117] "RemoveContainer" containerID="e8694d8ea38d9f3f06988647c4039ceb523c95f0a9f6604e7563e72b696cccdd"
Sep 06 10:48:49.379000 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:49.378962    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:48:55.741710 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:48:55.741678    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:49:01.108848 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:01.108812    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:49:01.335485 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:01.335454    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:49:01.436195 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:01.436150    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:49:01.536265 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:01.536210    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:49:01.542637 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:01.542610    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7d2fed-86447"]
Sep 06 10:49:01.545226 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:01.545208    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-7d2fed-86447"]
Sep 06 10:49:01.634363 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:01.634301    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:49:01.932965 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:01.932930    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:49:02.754452 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:02.754411    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcc11279-943c-40fb-a8f8-3bff91c91441" path="/var/lib/kubelet/pods/dcc11279-943c-40fb-a8f8-3bff91c91441/volumes"
Sep 06 10:49:07.003115 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:07.003047    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:49:10.563809 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:10.563770    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:49:18.669303 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:18.669261    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:49:43.697337 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:43.697286    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:49:44.199846 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:44.199805    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:49:49.665794 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:49.665737    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:49:49.719573 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:49.719525    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:49:49.942485 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:49.942405    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"]
Sep 06 10:49:49.942661 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:49.942637    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9" podUID="315d6173-d4c1-4390-983e-ce7aff5671b7" containerName="istio-proxy" containerID="cri-o://9dfd000ec4ab85e22476db60e2df238a9993ab12026d4122fc14d90f98926854" gracePeriod=30
Sep 06 10:49:49.957823 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:49.957798    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:49:50.329070 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:50.328977    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5be549-tvl9b"]
Sep 06 10:49:50.329501 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:50.329483    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ec84614-0676-4ed6-a20e-1a42465f6842" containerName="istio-proxy"
Sep 06 10:49:50.329611 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:50.329503    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ec84614-0676-4ed6-a20e-1a42465f6842" containerName="istio-proxy"
Sep 06 10:49:50.329611 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:50.329525    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ec84614-0676-4ed6-a20e-1a42465f6842" containerName="istio-proxy"
Sep 06 10:49:50.329611 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:50.329535    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ec84614-0676-4ed6-a20e-1a42465f6842" containerName="istio-proxy"
Sep 06 10:49:50.329611 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:50.329567    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcc11279-943c-40fb-a8f8-3bff91c91441" containerName="revoke-keys"
Sep 06 10:49:50.329611 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:50.329577    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcc11279-943c-40fb-a8f8-3bff91c91441" containerName="revoke-keys"
Sep 06 10:49:50.329872 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:50.329675    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ec84614-0676-4ed6-a20e-1a42465f6842" containerName="istio-proxy"
Sep 06 10:49:50.329872 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:50.329690    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcc11279-943c-40fb-a8f8-3bff91c91441" containerName="revoke-keys"
Sep 06 10:49:50.333203 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:50.333181    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5be549-tvl9b"
Sep 06 10:49:50.335895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:50.335877    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n5b2f\""
Sep 06 10:49:50.340036 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:50.340009    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5be549-tvl9b"]
Sep 06 10:49:50.450949 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:50.450920    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4979a66c-92ca-4cd3-945d-9dd492a02772-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-5be549-tvl9b\" (UID: \"4979a66c-92ca-4cd3-945d-9dd492a02772\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5be549-tvl9b"
Sep 06 10:49:50.519176 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:50.519130    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:49:50.551481 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:50.551446    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4979a66c-92ca-4cd3-945d-9dd492a02772-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-5be549-tvl9b\" (UID: \"4979a66c-92ca-4cd3-945d-9dd492a02772\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5be549-tvl9b"
Sep 06 10:49:50.552116 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:50.552097    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4979a66c-92ca-4cd3-945d-9dd492a02772-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-5be549-tvl9b\" (UID: \"4979a66c-92ca-4cd3-945d-9dd492a02772\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5be549-tvl9b"
Sep 06 10:49:50.645267 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:50.645191    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5be549-tvl9b"
Sep 06 10:49:50.916089 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:50.916057    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5be549-tvl9b"]
Sep 06 10:49:50.917011 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:49:50.916985    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4979a66c_92ca_4cd3_945d_9dd492a02772.slice/crio-e58d3ac6e583f95baa426969db7661e73a1eec3a6f9fa068c2888a48a43d3866 WatchSource:0}: Error finding container e58d3ac6e583f95baa426969db7661e73a1eec3a6f9fa068c2888a48a43d3866: Status 404 returned error can't find the container with id e58d3ac6e583f95baa426969db7661e73a1eec3a6f9fa068c2888a48a43d3866
Sep 06 10:49:51.559566 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:51.559487    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5be549-tvl9b" event={"ID":"4979a66c-92ca-4cd3-945d-9dd492a02772","Type":"ContainerStarted","Data":"f3e2a18d13052ec336c06b965ed6262add2bf90f21063c7581961b58956d4847"}
Sep 06 10:49:51.559566 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:51.559548    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5be549-tvl9b" event={"ID":"4979a66c-92ca-4cd3-945d-9dd492a02772","Type":"ContainerStarted","Data":"e58d3ac6e583f95baa426969db7661e73a1eec3a6f9fa068c2888a48a43d3866"}
Sep 06 10:49:51.574918 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:51.574869    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5be549-tvl9b" podStartSLOduration=1.574853751 podStartE2EDuration="1.574853751s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:49:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:49:51.573556022 +0000 UTC m=+1683.351975436" watchObservedRunningTime="2026-09-06 10:49:51.574853751 +0000 UTC m=+1683.353273232"
Sep 06 10:49:52.567479 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:52.567446    2561 generic.go:356] "Generic (PLEG): container finished" podID="4979a66c-92ca-4cd3-945d-9dd492a02772" containerID="f3e2a18d13052ec336c06b965ed6262add2bf90f21063c7581961b58956d4847" exitCode=0
Sep 06 10:49:52.567862 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:52.567530    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5be549-tvl9b" event={"ID":"4979a66c-92ca-4cd3-945d-9dd492a02772","Type":"ContainerDied","Data":"f3e2a18d13052ec336c06b965ed6262add2bf90f21063c7581961b58956d4847"}
Sep 06 10:49:53.707436 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:53.707410    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5be549-tvl9b"
Sep 06 10:49:53.777759 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:53.777724    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4979a66c-92ca-4cd3-945d-9dd492a02772-maas-api-service-ca\") pod \"4979a66c-92ca-4cd3-945d-9dd492a02772\" (UID: \"4979a66c-92ca-4cd3-945d-9dd492a02772\") "
Sep 06 10:49:53.778057 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:53.778026    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4979a66c-92ca-4cd3-945d-9dd492a02772-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4979a66c-92ca-4cd3-945d-9dd492a02772" (UID: "4979a66c-92ca-4cd3-945d-9dd492a02772"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:49:53.778198 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:53.778174    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4979a66c-92ca-4cd3-945d-9dd492a02772-maas-api-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:49:54.581160 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:54.581128    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5be549-tvl9b"
Sep 06 10:49:54.581160 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:54.581149    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5be549-tvl9b" event={"ID":"4979a66c-92ca-4cd3-945d-9dd492a02772","Type":"ContainerDied","Data":"e58d3ac6e583f95baa426969db7661e73a1eec3a6f9fa068c2888a48a43d3866"}
Sep 06 10:49:54.581402 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:54.581219    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e58d3ac6e583f95baa426969db7661e73a1eec3a6f9fa068c2888a48a43d3866"
Sep 06 10:49:55.193426 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.193399    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:49:55.293662 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.293568    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-token\") pod \"315d6173-d4c1-4390-983e-ce7aff5671b7\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") "
Sep 06 10:49:55.293662 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.293622    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-data\") pod \"315d6173-d4c1-4390-983e-ce7aff5671b7\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") "
Sep 06 10:49:55.293897 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.293668    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/315d6173-d4c1-4390-983e-ce7aff5671b7-istiod-ca-cert\") pod \"315d6173-d4c1-4390-983e-ce7aff5671b7\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") "
Sep 06 10:49:55.293897 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.293728    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-envoy\") pod \"315d6173-d4c1-4390-983e-ce7aff5671b7\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") "
Sep 06 10:49:55.293897 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.293763    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjdhd\" (UniqueName: \"kubernetes.io/projected/315d6173-d4c1-4390-983e-ce7aff5671b7-kube-api-access-xjdhd\") pod \"315d6173-d4c1-4390-983e-ce7aff5671b7\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") "
Sep 06 10:49:55.293897 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.293801    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-workload-socket\") pod \"315d6173-d4c1-4390-983e-ce7aff5671b7\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") "
Sep 06 10:49:55.293897 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.293832    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-workload-certs\") pod \"315d6173-d4c1-4390-983e-ce7aff5671b7\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") "
Sep 06 10:49:55.294144 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.293922    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-credential-socket\") pod \"315d6173-d4c1-4390-983e-ce7aff5671b7\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") "
Sep 06 10:49:55.294144 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.293955    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-podinfo\") pod \"315d6173-d4c1-4390-983e-ce7aff5671b7\" (UID: \"315d6173-d4c1-4390-983e-ce7aff5671b7\") "
Sep 06 10:49:55.294241 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.293918    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-data" (OuterVolumeSpecName: "istio-data") pod "315d6173-d4c1-4390-983e-ce7aff5671b7" (UID: "315d6173-d4c1-4390-983e-ce7aff5671b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:49:55.294241 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.294111    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "315d6173-d4c1-4390-983e-ce7aff5671b7" (UID: "315d6173-d4c1-4390-983e-ce7aff5671b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:49:55.294241 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.294148    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "315d6173-d4c1-4390-983e-ce7aff5671b7" (UID: "315d6173-d4c1-4390-983e-ce7aff5671b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:49:55.294241 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.294201    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/315d6173-d4c1-4390-983e-ce7aff5671b7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "315d6173-d4c1-4390-983e-ce7aff5671b7" (UID: "315d6173-d4c1-4390-983e-ce7aff5671b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:49:55.294442 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.294300    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "315d6173-d4c1-4390-983e-ce7aff5671b7" (UID: "315d6173-d4c1-4390-983e-ce7aff5671b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:49:55.294442 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.294428    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:49:55.294529 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.294450    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:49:55.294529 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.294467    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:49:55.294529 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.294481    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:49:55.294529 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.294494    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/315d6173-d4c1-4390-983e-ce7aff5671b7-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:49:55.296000 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.295976    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "315d6173-d4c1-4390-983e-ce7aff5671b7" (UID: "315d6173-d4c1-4390-983e-ce7aff5671b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:49:55.296125 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.296025    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/315d6173-d4c1-4390-983e-ce7aff5671b7-kube-api-access-xjdhd" (OuterVolumeSpecName: "kube-api-access-xjdhd") pod "315d6173-d4c1-4390-983e-ce7aff5671b7" (UID: "315d6173-d4c1-4390-983e-ce7aff5671b7"). InnerVolumeSpecName "kube-api-access-xjdhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:49:55.296216 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.296196    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-token" (OuterVolumeSpecName: "istio-token") pod "315d6173-d4c1-4390-983e-ce7aff5671b7" (UID: "315d6173-d4c1-4390-983e-ce7aff5671b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:49:55.296337 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.296310    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "315d6173-d4c1-4390-983e-ce7aff5671b7" (UID: "315d6173-d4c1-4390-983e-ce7aff5671b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 10:49:55.395145 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.395120    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:49:55.395145 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.395140    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:49:55.395145 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.395149    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjdhd\" (UniqueName: \"kubernetes.io/projected/315d6173-d4c1-4390-983e-ce7aff5671b7-kube-api-access-xjdhd\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:49:55.395358 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.395159    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/315d6173-d4c1-4390-983e-ce7aff5671b7-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:49:55.588979 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.588888    2561 generic.go:356] "Generic (PLEG): container finished" podID="315d6173-d4c1-4390-983e-ce7aff5671b7" containerID="9dfd000ec4ab85e22476db60e2df238a9993ab12026d4122fc14d90f98926854" exitCode=0
Sep 06 10:49:55.588979 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.588937    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"
Sep 06 10:49:55.589163 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.588937    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9" event={"ID":"315d6173-d4c1-4390-983e-ce7aff5671b7","Type":"ContainerDied","Data":"9dfd000ec4ab85e22476db60e2df238a9993ab12026d4122fc14d90f98926854"}
Sep 06 10:49:55.589163 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.589056    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9" event={"ID":"315d6173-d4c1-4390-983e-ce7aff5671b7","Type":"ContainerDied","Data":"2493dbfa466ca1f91b0bc7e0273a4677165226d771d496f98187f1a0ce640bff"}
Sep 06 10:49:55.589163 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.589082    2561 scope.go:117] "RemoveContainer" containerID="9dfd000ec4ab85e22476db60e2df238a9993ab12026d4122fc14d90f98926854"
Sep 06 10:49:55.599630 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.599615    2561 scope.go:117] "RemoveContainer" containerID="3a848d5f216b0b4c5ec0fed1b124b8689fdde83e1435e62f9f71beaf5962a047"
Sep 06 10:49:55.608498 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.608474    2561 scope.go:117] "RemoveContainer" containerID="9dfd000ec4ab85e22476db60e2df238a9993ab12026d4122fc14d90f98926854"
Sep 06 10:49:55.608771 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:49:55.608754    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dfd000ec4ab85e22476db60e2df238a9993ab12026d4122fc14d90f98926854\": container with ID starting with 9dfd000ec4ab85e22476db60e2df238a9993ab12026d4122fc14d90f98926854 not found: ID does not exist" containerID="9dfd000ec4ab85e22476db60e2df238a9993ab12026d4122fc14d90f98926854"
Sep 06 10:49:55.608823 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.608803    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dfd000ec4ab85e22476db60e2df238a9993ab12026d4122fc14d90f98926854"} err="failed to get container status \"9dfd000ec4ab85e22476db60e2df238a9993ab12026d4122fc14d90f98926854\": rpc error: code = NotFound desc = could not find container \"9dfd000ec4ab85e22476db60e2df238a9993ab12026d4122fc14d90f98926854\": container with ID starting with 9dfd000ec4ab85e22476db60e2df238a9993ab12026d4122fc14d90f98926854 not found: ID does not exist"
Sep 06 10:49:55.608823 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.608818    2561 scope.go:117] "RemoveContainer" containerID="3a848d5f216b0b4c5ec0fed1b124b8689fdde83e1435e62f9f71beaf5962a047"
Sep 06 10:49:55.609081 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:49:55.609062    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a848d5f216b0b4c5ec0fed1b124b8689fdde83e1435e62f9f71beaf5962a047\": container with ID starting with 3a848d5f216b0b4c5ec0fed1b124b8689fdde83e1435e62f9f71beaf5962a047 not found: ID does not exist" containerID="3a848d5f216b0b4c5ec0fed1b124b8689fdde83e1435e62f9f71beaf5962a047"
Sep 06 10:49:55.609140 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.609094    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a848d5f216b0b4c5ec0fed1b124b8689fdde83e1435e62f9f71beaf5962a047"} err="failed to get container status \"3a848d5f216b0b4c5ec0fed1b124b8689fdde83e1435e62f9f71beaf5962a047\": rpc error: code = NotFound desc = could not find container \"3a848d5f216b0b4c5ec0fed1b124b8689fdde83e1435e62f9f71beaf5962a047\": container with ID starting with 3a848d5f216b0b4c5ec0fed1b124b8689fdde83e1435e62f9f71beaf5962a047 not found: ID does not exist"
Sep 06 10:49:55.611377 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.611359    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"]
Sep 06 10:49:55.616669 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:55.616646    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-7d2fed-openshift-default-944779646-v2qn9"]
Sep 06 10:49:56.755202 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:49:56.755160    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="315d6173-d4c1-4390-983e-ce7aff5671b7" path="/var/lib/kubelet/pods/315d6173-d4c1-4390-983e-ce7aff5671b7/volumes"
Sep 06 10:50:00.826490 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:00.826455    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:00.926634 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:00.926599    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:01.027178 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:01.027127    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:01.098591 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:01.098502    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5be549-tvl9b"]
Sep 06 10:50:01.099654 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:01.099625    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:01.101311 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:01.101285    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-5be549-tvl9b"]
Sep 06 10:50:01.157586 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:01.157555    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:01.495936 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:01.495905    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:02.755209 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:02.755178    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4979a66c-92ca-4cd3-945d-9dd492a02772" path="/var/lib/kubelet/pods/4979a66c-92ca-4cd3-945d-9dd492a02772/volumes"
Sep 06 10:50:07.319668 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:07.319634    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:07.422396 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:07.422363    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:07.633611 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:07.633528    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"]
Sep 06 10:50:07.633771 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:07.633754    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk" podUID="6e28ec36-27c8-4e46-a688-5e4b951d9cc2" containerName="istio-proxy" containerID="cri-o://d7d1e60af1ebcaf825344540c16d9814b9c4ed55a4aceb8361ed71aebbb6ebf1" gracePeriod=30
Sep 06 10:50:07.703941 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:07.703908    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:07.971719 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:07.971688    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6751d7-w6xp2"]
Sep 06 10:50:07.972122 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:07.972108    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4979a66c-92ca-4cd3-945d-9dd492a02772" containerName="revoke-keys"
Sep 06 10:50:07.972180 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:07.972123    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4979a66c-92ca-4cd3-945d-9dd492a02772" containerName="revoke-keys"
Sep 06 10:50:07.972180 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:07.972146    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="315d6173-d4c1-4390-983e-ce7aff5671b7" containerName="istio-proxy"
Sep 06 10:50:07.972180 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:07.972152    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="315d6173-d4c1-4390-983e-ce7aff5671b7" containerName="istio-proxy"
Sep 06 10:50:07.972180 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:07.972158    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="315d6173-d4c1-4390-983e-ce7aff5671b7" containerName="istio-proxy"
Sep 06 10:50:07.972180 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:07.972164    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="315d6173-d4c1-4390-983e-ce7aff5671b7" containerName="istio-proxy"
Sep 06 10:50:07.972361 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:07.972220    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="315d6173-d4c1-4390-983e-ce7aff5671b7" containerName="istio-proxy"
Sep 06 10:50:07.972361 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:07.972232    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="315d6173-d4c1-4390-983e-ce7aff5671b7" containerName="istio-proxy"
Sep 06 10:50:07.972361 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:07.972237    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4979a66c-92ca-4cd3-945d-9dd492a02772" containerName="revoke-keys"
Sep 06 10:50:07.972361 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:07.972245    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ec84614-0676-4ed6-a20e-1a42465f6842" containerName="istio-proxy"
Sep 06 10:50:07.976940 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:07.976921    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6751d7-w6xp2"
Sep 06 10:50:07.979452 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:07.979430    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n5b2f\""
Sep 06 10:50:07.982698 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:07.982673    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6751d7-w6xp2"]
Sep 06 10:50:08.092830 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:08.092796    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:08.120303 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:08.120273    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf44659-476d-45c1-abfd-63419e8ad806-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-6751d7-w6xp2\" (UID: \"8cf44659-476d-45c1-abfd-63419e8ad806\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6751d7-w6xp2"
Sep 06 10:50:08.221470 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:08.221431    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf44659-476d-45c1-abfd-63419e8ad806-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-6751d7-w6xp2\" (UID: \"8cf44659-476d-45c1-abfd-63419e8ad806\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6751d7-w6xp2"
Sep 06 10:50:08.222071 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:08.222024    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf44659-476d-45c1-abfd-63419e8ad806-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-6751d7-w6xp2\" (UID: \"8cf44659-476d-45c1-abfd-63419e8ad806\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6751d7-w6xp2"
Sep 06 10:50:08.288841 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:08.288814    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6751d7-w6xp2"
Sep 06 10:50:08.562308 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:08.562282    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6751d7-w6xp2"]
Sep 06 10:50:08.564002 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:50:08.563971    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cf44659_476d_45c1_abfd_63419e8ad806.slice/crio-0d823b72d10bfd4db84d96f5aa5c5765119981d1dfc395b3a6c966183c07c4cf WatchSource:0}: Error finding container 0d823b72d10bfd4db84d96f5aa5c5765119981d1dfc395b3a6c966183c07c4cf: Status 404 returned error can't find the container with id 0d823b72d10bfd4db84d96f5aa5c5765119981d1dfc395b3a6c966183c07c4cf
Sep 06 10:50:08.670600 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:08.670567    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6751d7-w6xp2" event={"ID":"8cf44659-476d-45c1-abfd-63419e8ad806","Type":"ContainerStarted","Data":"0d823b72d10bfd4db84d96f5aa5c5765119981d1dfc395b3a6c966183c07c4cf"}
Sep 06 10:50:09.678705 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:09.678675    2561 generic.go:356] "Generic (PLEG): container finished" podID="8cf44659-476d-45c1-abfd-63419e8ad806" containerID="74c675634613b23a55f437908f0a706e2ad38d7dcc9da2943f676aba278d865d" exitCode=0
Sep 06 10:50:09.679062 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:09.678733    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6751d7-w6xp2" event={"ID":"8cf44659-476d-45c1-abfd-63419e8ad806","Type":"ContainerDied","Data":"74c675634613b23a55f437908f0a706e2ad38d7dcc9da2943f676aba278d865d"}
Sep 06 10:50:10.840093 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:10.840063    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6751d7-w6xp2"
Sep 06 10:50:10.947203 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:10.947124    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf44659-476d-45c1-abfd-63419e8ad806-maas-api-service-ca\") pod \"8cf44659-476d-45c1-abfd-63419e8ad806\" (UID: \"8cf44659-476d-45c1-abfd-63419e8ad806\") "
Sep 06 10:50:10.947505 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:10.947480    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cf44659-476d-45c1-abfd-63419e8ad806-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8cf44659-476d-45c1-abfd-63419e8ad806" (UID: "8cf44659-476d-45c1-abfd-63419e8ad806"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:50:11.048242 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:11.048162    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf44659-476d-45c1-abfd-63419e8ad806-maas-api-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:11.692446 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:11.692415    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6751d7-w6xp2"
Sep 06 10:50:11.692749 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:11.692459    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6751d7-w6xp2" event={"ID":"8cf44659-476d-45c1-abfd-63419e8ad806","Type":"ContainerDied","Data":"0d823b72d10bfd4db84d96f5aa5c5765119981d1dfc395b3a6c966183c07c4cf"}
Sep 06 10:50:11.692749 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:11.692508    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d823b72d10bfd4db84d96f5aa5c5765119981d1dfc395b3a6c966183c07c4cf"
Sep 06 10:50:12.895911 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:12.895806    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:50:13.069303 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.069267    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jlln\" (UniqueName: \"kubernetes.io/projected/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-kube-api-access-7jlln\") pod \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") "
Sep 06 10:50:13.069516 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.069348    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-envoy\") pod \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") "
Sep 06 10:50:13.069516 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.069368    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-credential-socket\") pod \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") "
Sep 06 10:50:13.069516 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.069405    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-podinfo\") pod \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") "
Sep 06 10:50:13.069682 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.069592    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-workload-certs\") pod \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") "
Sep 06 10:50:13.069682 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.069676    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-token\") pod \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") "
Sep 06 10:50:13.069792 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.069713    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6e28ec36-27c8-4e46-a688-5e4b951d9cc2" (UID: "6e28ec36-27c8-4e46-a688-5e4b951d9cc2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:50:13.069792 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.069733    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-workload-socket\") pod \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") "
Sep 06 10:50:13.069792 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.069782    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6e28ec36-27c8-4e46-a688-5e4b951d9cc2" (UID: "6e28ec36-27c8-4e46-a688-5e4b951d9cc2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:50:13.069955 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.069833    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istiod-ca-cert\") pod \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") "
Sep 06 10:50:13.069955 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.069864    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-data\") pod \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\" (UID: \"6e28ec36-27c8-4e46-a688-5e4b951d9cc2\") "
Sep 06 10:50:13.070204 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.070129    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6e28ec36-27c8-4e46-a688-5e4b951d9cc2" (UID: "6e28ec36-27c8-4e46-a688-5e4b951d9cc2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:50:13.070289 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.070226    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:13.070289 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.070231    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-data" (OuterVolumeSpecName: "istio-data") pod "6e28ec36-27c8-4e46-a688-5e4b951d9cc2" (UID: "6e28ec36-27c8-4e46-a688-5e4b951d9cc2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:50:13.070289 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.070247    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:13.070289 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.070261    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:13.070289 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.070267    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6e28ec36-27c8-4e46-a688-5e4b951d9cc2" (UID: "6e28ec36-27c8-4e46-a688-5e4b951d9cc2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:50:13.072086 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.072065    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6e28ec36-27c8-4e46-a688-5e4b951d9cc2" (UID: "6e28ec36-27c8-4e46-a688-5e4b951d9cc2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 10:50:13.072086 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.072076    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-kube-api-access-7jlln" (OuterVolumeSpecName: "kube-api-access-7jlln") pod "6e28ec36-27c8-4e46-a688-5e4b951d9cc2" (UID: "6e28ec36-27c8-4e46-a688-5e4b951d9cc2"). InnerVolumeSpecName "kube-api-access-7jlln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:50:13.072241 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.072090    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6e28ec36-27c8-4e46-a688-5e4b951d9cc2" (UID: "6e28ec36-27c8-4e46-a688-5e4b951d9cc2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:50:13.072241 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.072102    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-token" (OuterVolumeSpecName: "istio-token") pod "6e28ec36-27c8-4e46-a688-5e4b951d9cc2" (UID: "6e28ec36-27c8-4e46-a688-5e4b951d9cc2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:50:13.171360 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.171298    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:13.171360 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.171357    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:13.171360 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.171367    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jlln\" (UniqueName: \"kubernetes.io/projected/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-kube-api-access-7jlln\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:13.171591 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.171376    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:13.171591 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.171385    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:13.171591 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.171392    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e28ec36-27c8-4e46-a688-5e4b951d9cc2-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:13.707057 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.707020    2561 generic.go:356] "Generic (PLEG): container finished" podID="6e28ec36-27c8-4e46-a688-5e4b951d9cc2" containerID="d7d1e60af1ebcaf825344540c16d9814b9c4ed55a4aceb8361ed71aebbb6ebf1" exitCode=0
Sep 06 10:50:13.707287 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.707075    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"
Sep 06 10:50:13.707287 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.707074    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk" event={"ID":"6e28ec36-27c8-4e46-a688-5e4b951d9cc2","Type":"ContainerDied","Data":"d7d1e60af1ebcaf825344540c16d9814b9c4ed55a4aceb8361ed71aebbb6ebf1"}
Sep 06 10:50:13.707287 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.707213    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk" event={"ID":"6e28ec36-27c8-4e46-a688-5e4b951d9cc2","Type":"ContainerDied","Data":"a1b8b9a7eea956c2e0a7f1921d2ff75b6ac54c16552f393a56b5c5005e1b3234"}
Sep 06 10:50:13.707287 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.707252    2561 scope.go:117] "RemoveContainer" containerID="d7d1e60af1ebcaf825344540c16d9814b9c4ed55a4aceb8361ed71aebbb6ebf1"
Sep 06 10:50:13.720458 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.720432    2561 scope.go:117] "RemoveContainer" containerID="c40d43932cbcfed324f91556b9c7e5807ed78b311d3249d6d47ba64939f72d6d"
Sep 06 10:50:13.730981 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.730956    2561 scope.go:117] "RemoveContainer" containerID="d7d1e60af1ebcaf825344540c16d9814b9c4ed55a4aceb8361ed71aebbb6ebf1"
Sep 06 10:50:13.731240 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.731224    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"]
Sep 06 10:50:13.731360 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:50:13.731274    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7d1e60af1ebcaf825344540c16d9814b9c4ed55a4aceb8361ed71aebbb6ebf1\": container with ID starting with d7d1e60af1ebcaf825344540c16d9814b9c4ed55a4aceb8361ed71aebbb6ebf1 not found: ID does not exist" containerID="d7d1e60af1ebcaf825344540c16d9814b9c4ed55a4aceb8361ed71aebbb6ebf1"
Sep 06 10:50:13.731360 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.731301    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7d1e60af1ebcaf825344540c16d9814b9c4ed55a4aceb8361ed71aebbb6ebf1"} err="failed to get container status \"d7d1e60af1ebcaf825344540c16d9814b9c4ed55a4aceb8361ed71aebbb6ebf1\": rpc error: code = NotFound desc = could not find container \"d7d1e60af1ebcaf825344540c16d9814b9c4ed55a4aceb8361ed71aebbb6ebf1\": container with ID starting with d7d1e60af1ebcaf825344540c16d9814b9c4ed55a4aceb8361ed71aebbb6ebf1 not found: ID does not exist"
Sep 06 10:50:13.731360 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.731336    2561 scope.go:117] "RemoveContainer" containerID="c40d43932cbcfed324f91556b9c7e5807ed78b311d3249d6d47ba64939f72d6d"
Sep 06 10:50:13.731620 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:50:13.731603    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c40d43932cbcfed324f91556b9c7e5807ed78b311d3249d6d47ba64939f72d6d\": container with ID starting with c40d43932cbcfed324f91556b9c7e5807ed78b311d3249d6d47ba64939f72d6d not found: ID does not exist" containerID="c40d43932cbcfed324f91556b9c7e5807ed78b311d3249d6d47ba64939f72d6d"
Sep 06 10:50:13.731673 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.731626    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c40d43932cbcfed324f91556b9c7e5807ed78b311d3249d6d47ba64939f72d6d"} err="failed to get container status \"c40d43932cbcfed324f91556b9c7e5807ed78b311d3249d6d47ba64939f72d6d\": rpc error: code = NotFound desc = could not find container \"c40d43932cbcfed324f91556b9c7e5807ed78b311d3249d6d47ba64939f72d6d\": container with ID starting with c40d43932cbcfed324f91556b9c7e5807ed78b311d3249d6d47ba64939f72d6d not found: ID does not exist"
Sep 06 10:50:13.733910 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:13.733889    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-5be549-openshift-default-86748d5bb8-pn5nk"]
Sep 06 10:50:14.754593 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:14.754559    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e28ec36-27c8-4e46-a688-5e4b951d9cc2" path="/var/lib/kubelet/pods/6e28ec36-27c8-4e46-a688-5e4b951d9cc2/volumes"
Sep 06 10:50:18.438747 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:18.438712    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:18.536999 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:18.536962    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:18.628832 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:18.628800    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6751d7-w6xp2"]
Sep 06 10:50:18.631484 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:18.631457    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:18.632651 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:18.632632    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-6751d7-w6xp2"]
Sep 06 10:50:18.690666 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:18.690607    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:18.756355 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:18.756308    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cf44659-476d-45c1-abfd-63419e8ad806" path="/var/lib/kubelet/pods/8cf44659-476d-45c1-abfd-63419e8ad806/volumes"
Sep 06 10:50:19.020112 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:19.020023    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:24.983561 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:24.983528    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:25.083675 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.083645    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:25.230545 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.230507    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"]
Sep 06 10:50:25.230808 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.230724    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn" podUID="eafa52ae-6ca8-4303-911d-9b15f11b78f4" containerName="istio-proxy" containerID="cri-o://d9feec06b1744c1a742c1bf5ee8f15034e033ada28074a114fd4d9c3e3a76220" gracePeriod=30
Sep 06 10:50:25.247564 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.247497    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:25.610148 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.610061    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-682ea0-5dtqw"]
Sep 06 10:50:25.610475 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.610462    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cf44659-476d-45c1-abfd-63419e8ad806" containerName="revoke-keys"
Sep 06 10:50:25.610535 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.610477    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cf44659-476d-45c1-abfd-63419e8ad806" containerName="revoke-keys"
Sep 06 10:50:25.610535 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.610488    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e28ec36-27c8-4e46-a688-5e4b951d9cc2" containerName="istio-proxy"
Sep 06 10:50:25.610535 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.610495    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e28ec36-27c8-4e46-a688-5e4b951d9cc2" containerName="istio-proxy"
Sep 06 10:50:25.610535 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.610509    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e28ec36-27c8-4e46-a688-5e4b951d9cc2" containerName="istio-proxy"
Sep 06 10:50:25.610535 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.610515    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e28ec36-27c8-4e46-a688-5e4b951d9cc2" containerName="istio-proxy"
Sep 06 10:50:25.610714 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.610585    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e28ec36-27c8-4e46-a688-5e4b951d9cc2" containerName="istio-proxy"
Sep 06 10:50:25.610714 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.610592    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e28ec36-27c8-4e46-a688-5e4b951d9cc2" containerName="istio-proxy"
Sep 06 10:50:25.610714 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.610602    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cf44659-476d-45c1-abfd-63419e8ad806" containerName="revoke-keys"
Sep 06 10:50:25.613774 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.613755    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-682ea0-5dtqw"
Sep 06 10:50:25.615867 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.615846    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-n5b2f\""
Sep 06 10:50:25.620502 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.620480    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-682ea0-5dtqw"]
Sep 06 10:50:25.685932 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.685899    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d53382ce-5c5e-4e14-8cbc-01a0339e489b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-682ea0-5dtqw\" (UID: \"d53382ce-5c5e-4e14-8cbc-01a0339e489b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-682ea0-5dtqw"
Sep 06 10:50:25.767911 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.767874    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:25.787198 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.787171    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d53382ce-5c5e-4e14-8cbc-01a0339e489b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-682ea0-5dtqw\" (UID: \"d53382ce-5c5e-4e14-8cbc-01a0339e489b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-682ea0-5dtqw"
Sep 06 10:50:25.787837 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.787819    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d53382ce-5c5e-4e14-8cbc-01a0339e489b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-682ea0-5dtqw\" (UID: \"d53382ce-5c5e-4e14-8cbc-01a0339e489b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-682ea0-5dtqw"
Sep 06 10:50:25.925770 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:25.925743    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-682ea0-5dtqw"
Sep 06 10:50:26.198550 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:26.198486    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-682ea0-5dtqw"]
Sep 06 10:50:26.201064 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:50:26.201039    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53382ce_5c5e_4e14_8cbc_01a0339e489b.slice/crio-bdb1f6868340de254530bdac020484a3d1bfc13d6e7f61b77f35d3fb5904d448 WatchSource:0}: Error finding container bdb1f6868340de254530bdac020484a3d1bfc13d6e7f61b77f35d3fb5904d448: Status 404 returned error can't find the container with id bdb1f6868340de254530bdac020484a3d1bfc13d6e7f61b77f35d3fb5904d448
Sep 06 10:50:26.802645 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:26.802555    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-682ea0-5dtqw" event={"ID":"d53382ce-5c5e-4e14-8cbc-01a0339e489b","Type":"ContainerStarted","Data":"55cad7a241001cb64162d933149a6521927c8ee5bb8dfbbbb3f79971c102d883"}
Sep 06 10:50:26.802830 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:26.802649    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-682ea0-5dtqw" event={"ID":"d53382ce-5c5e-4e14-8cbc-01a0339e489b","Type":"ContainerStarted","Data":"bdb1f6868340de254530bdac020484a3d1bfc13d6e7f61b77f35d3fb5904d448"}
Sep 06 10:50:26.817860 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:26.817808    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-682ea0-5dtqw" podStartSLOduration=1.817794058 podStartE2EDuration="1.817794058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:50:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:50:26.816927045 +0000 UTC m=+1718.595346459" watchObservedRunningTime="2026-09-06 10:50:26.817794058 +0000 UTC m=+1718.596213471"
Sep 06 10:50:27.810430 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:27.810391    2561 generic.go:356] "Generic (PLEG): container finished" podID="d53382ce-5c5e-4e14-8cbc-01a0339e489b" containerID="55cad7a241001cb64162d933149a6521927c8ee5bb8dfbbbb3f79971c102d883" exitCode=0
Sep 06 10:50:27.810786 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:27.810475    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-682ea0-5dtqw" event={"ID":"d53382ce-5c5e-4e14-8cbc-01a0339e489b","Type":"ContainerDied","Data":"55cad7a241001cb64162d933149a6521927c8ee5bb8dfbbbb3f79971c102d883"}
Sep 06 10:50:28.951771 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:28.951749    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-682ea0-5dtqw"
Sep 06 10:50:29.024197 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:29.024163    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d53382ce-5c5e-4e14-8cbc-01a0339e489b-maas-api-service-ca\") pod \"d53382ce-5c5e-4e14-8cbc-01a0339e489b\" (UID: \"d53382ce-5c5e-4e14-8cbc-01a0339e489b\") "
Sep 06 10:50:29.024606 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:29.024583    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d53382ce-5c5e-4e14-8cbc-01a0339e489b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d53382ce-5c5e-4e14-8cbc-01a0339e489b" (UID: "d53382ce-5c5e-4e14-8cbc-01a0339e489b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:50:29.125527 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:29.125429    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d53382ce-5c5e-4e14-8cbc-01a0339e489b-maas-api-service-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:29.823694 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:29.823658    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-682ea0-5dtqw"
Sep 06 10:50:29.823895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:29.823706    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-682ea0-5dtqw" event={"ID":"d53382ce-5c5e-4e14-8cbc-01a0339e489b","Type":"ContainerDied","Data":"bdb1f6868340de254530bdac020484a3d1bfc13d6e7f61b77f35d3fb5904d448"}
Sep 06 10:50:29.823895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:29.823751    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bdb1f6868340de254530bdac020484a3d1bfc13d6e7f61b77f35d3fb5904d448"
Sep 06 10:50:30.490373 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.490346    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:50:30.538188 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.538097    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-workload-certs\") pod \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") "
Sep 06 10:50:30.538188 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.538164    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8fx7\" (UniqueName: \"kubernetes.io/projected/eafa52ae-6ca8-4303-911d-9b15f11b78f4-kube-api-access-n8fx7\") pod \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") "
Sep 06 10:50:30.538447 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.538201    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istiod-ca-cert\") pod \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") "
Sep 06 10:50:30.538447 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.538257    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-credential-socket\") pod \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") "
Sep 06 10:50:30.538447 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.538276    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-token\") pod \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") "
Sep 06 10:50:30.538447 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.538314    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-data\") pod \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") "
Sep 06 10:50:30.538447 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.538358    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-envoy\") pod \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") "
Sep 06 10:50:30.538447 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.538400    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-workload-socket\") pod \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") "
Sep 06 10:50:30.538447 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.538437    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-podinfo\") pod \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\" (UID: \"eafa52ae-6ca8-4303-911d-9b15f11b78f4\") "
Sep 06 10:50:30.538447 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.538433    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eafa52ae-6ca8-4303-911d-9b15f11b78f4" (UID: "eafa52ae-6ca8-4303-911d-9b15f11b78f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:50:30.538895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.538543    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eafa52ae-6ca8-4303-911d-9b15f11b78f4" (UID: "eafa52ae-6ca8-4303-911d-9b15f11b78f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:50:30.538895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.538549    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eafa52ae-6ca8-4303-911d-9b15f11b78f4" (UID: "eafa52ae-6ca8-4303-911d-9b15f11b78f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:50:30.538895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.538759    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:30.538895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.538772    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:30.538895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.538781    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:30.538895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.538860    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "eafa52ae-6ca8-4303-911d-9b15f11b78f4" (UID: "eafa52ae-6ca8-4303-911d-9b15f11b78f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:50:30.539217 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.538922    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eafa52ae-6ca8-4303-911d-9b15f11b78f4" (UID: "eafa52ae-6ca8-4303-911d-9b15f11b78f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:50:30.540662 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.540636    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eafa52ae-6ca8-4303-911d-9b15f11b78f4-kube-api-access-n8fx7" (OuterVolumeSpecName: "kube-api-access-n8fx7") pod "eafa52ae-6ca8-4303-911d-9b15f11b78f4" (UID: "eafa52ae-6ca8-4303-911d-9b15f11b78f4"). InnerVolumeSpecName "kube-api-access-n8fx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:50:30.540662 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.540654    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eafa52ae-6ca8-4303-911d-9b15f11b78f4" (UID: "eafa52ae-6ca8-4303-911d-9b15f11b78f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:50:30.541039 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.541011    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eafa52ae-6ca8-4303-911d-9b15f11b78f4" (UID: "eafa52ae-6ca8-4303-911d-9b15f11b78f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 10:50:30.541162 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.541072    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "eafa52ae-6ca8-4303-911d-9b15f11b78f4" (UID: "eafa52ae-6ca8-4303-911d-9b15f11b78f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:50:30.639700 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.639674    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:30.639700 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.639698    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:30.639875 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.639707    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eafa52ae-6ca8-4303-911d-9b15f11b78f4-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:30.639875 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.639716    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:30.639875 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.639724    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8fx7\" (UniqueName: \"kubernetes.io/projected/eafa52ae-6ca8-4303-911d-9b15f11b78f4-kube-api-access-n8fx7\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:30.639875 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.639734    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eafa52ae-6ca8-4303-911d-9b15f11b78f4-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:30.832280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.832186    2561 generic.go:356] "Generic (PLEG): container finished" podID="eafa52ae-6ca8-4303-911d-9b15f11b78f4" containerID="d9feec06b1744c1a742c1bf5ee8f15034e033ada28074a114fd4d9c3e3a76220" exitCode=0
Sep 06 10:50:30.832280 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.832233    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"
Sep 06 10:50:30.832492 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.832274    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn" event={"ID":"eafa52ae-6ca8-4303-911d-9b15f11b78f4","Type":"ContainerDied","Data":"d9feec06b1744c1a742c1bf5ee8f15034e033ada28074a114fd4d9c3e3a76220"}
Sep 06 10:50:30.832492 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.832350    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn" event={"ID":"eafa52ae-6ca8-4303-911d-9b15f11b78f4","Type":"ContainerDied","Data":"356179d23c6da295118add53df5e0040975b40e12b1cb813b0631551e007ddfc"}
Sep 06 10:50:30.832492 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.832380    2561 scope.go:117] "RemoveContainer" containerID="d9feec06b1744c1a742c1bf5ee8f15034e033ada28074a114fd4d9c3e3a76220"
Sep 06 10:50:30.844394 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.844373    2561 scope.go:117] "RemoveContainer" containerID="4a5aab000926dc4dafabd88c3ce94c1ec59203e1260cf55839d08b9e54622527"
Sep 06 10:50:30.852054 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.851965    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"]
Sep 06 10:50:30.854603 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.854582    2561 scope.go:117] "RemoveContainer" containerID="d9feec06b1744c1a742c1bf5ee8f15034e033ada28074a114fd4d9c3e3a76220"
Sep 06 10:50:30.854887 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:50:30.854864    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9feec06b1744c1a742c1bf5ee8f15034e033ada28074a114fd4d9c3e3a76220\": container with ID starting with d9feec06b1744c1a742c1bf5ee8f15034e033ada28074a114fd4d9c3e3a76220 not found: ID does not exist" containerID="d9feec06b1744c1a742c1bf5ee8f15034e033ada28074a114fd4d9c3e3a76220"
Sep 06 10:50:30.854987 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.854893    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9feec06b1744c1a742c1bf5ee8f15034e033ada28074a114fd4d9c3e3a76220"} err="failed to get container status \"d9feec06b1744c1a742c1bf5ee8f15034e033ada28074a114fd4d9c3e3a76220\": rpc error: code = NotFound desc = could not find container \"d9feec06b1744c1a742c1bf5ee8f15034e033ada28074a114fd4d9c3e3a76220\": container with ID starting with d9feec06b1744c1a742c1bf5ee8f15034e033ada28074a114fd4d9c3e3a76220 not found: ID does not exist"
Sep 06 10:50:30.854987 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.854910    2561 scope.go:117] "RemoveContainer" containerID="4a5aab000926dc4dafabd88c3ce94c1ec59203e1260cf55839d08b9e54622527"
Sep 06 10:50:30.854987 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.854930    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-6751d7-openshift-default-5c489dd67b-9hxxn"]
Sep 06 10:50:30.855225 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:50:30.855205    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a5aab000926dc4dafabd88c3ce94c1ec59203e1260cf55839d08b9e54622527\": container with ID starting with 4a5aab000926dc4dafabd88c3ce94c1ec59203e1260cf55839d08b9e54622527 not found: ID does not exist" containerID="4a5aab000926dc4dafabd88c3ce94c1ec59203e1260cf55839d08b9e54622527"
Sep 06 10:50:30.855268 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:30.855231    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a5aab000926dc4dafabd88c3ce94c1ec59203e1260cf55839d08b9e54622527"} err="failed to get container status \"4a5aab000926dc4dafabd88c3ce94c1ec59203e1260cf55839d08b9e54622527\": rpc error: code = NotFound desc = could not find container \"4a5aab000926dc4dafabd88c3ce94c1ec59203e1260cf55839d08b9e54622527\": container with ID starting with 4a5aab000926dc4dafabd88c3ce94c1ec59203e1260cf55839d08b9e54622527 not found: ID does not exist"
Sep 06 10:50:31.897471 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:31.897440    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:31.951552 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:31.951519    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:32.754687 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:32.754653    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eafa52ae-6ca8-4303-911d-9b15f11b78f4" path="/var/lib/kubelet/pods/eafa52ae-6ca8-4303-911d-9b15f11b78f4/volumes"
Sep 06 10:50:36.082171 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:36.082141    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-682ea0-29811525-qs5xd"]
Sep 06 10:50:36.083551 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:36.083524    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:36.084912 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:36.084890    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-682ea0-29811525-qs5xd"]
Sep 06 10:50:36.149349 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:36.149309    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:36.251236 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:36.251206    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:36.317638 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:36.317602    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:36.331004 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:36.330806    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-682ea0-5dtqw"]
Sep 06 10:50:36.333475 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:36.333422    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-682ea0-5dtqw"]
Sep 06 10:50:36.376841 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:36.376814    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:36.703226 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:36.703194    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:36.754199 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:36.754167    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94040711-644f-46d5-bfb9-0273168c4f5a" path="/var/lib/kubelet/pods/94040711-644f-46d5-bfb9-0273168c4f5a/volumes"
Sep 06 10:50:36.754530 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:36.754515    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d53382ce-5c5e-4e14-8cbc-01a0339e489b" path="/var/lib/kubelet/pods/d53382ce-5c5e-4e14-8cbc-01a0339e489b/volumes"
Sep 06 10:50:40.679232 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:40.679189    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:42.725257 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:42.725225    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:42.833676 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:42.833639    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:42.970940 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:42.970905    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"]
Sep 06 10:50:42.971142 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:42.971120    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k" podUID="6c9472bf-075b-4340-a149-4f412da39a01" containerName="istio-proxy" containerID="cri-o://e5a1f71a1b2aedb954265888942e27a0228a3ef8b16782f52e5893b9176c56f3" gracePeriod=30
Sep 06 10:50:43.004944 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:43.004848    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:50:47.769346 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:47.769278    2561 patch_prober.go:28] interesting pod/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 06 10:50:47.769744 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:47.769367    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k" podUID="6c9472bf-075b-4340-a149-4f412da39a01" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 10:50:48.221188 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.221157    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:50:48.301652 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.301612    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c9472bf-075b-4340-a149-4f412da39a01-istio-token\") pod \"6c9472bf-075b-4340-a149-4f412da39a01\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") "
Sep 06 10:50:48.301652 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.301659    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-workload-certs\") pod \"6c9472bf-075b-4340-a149-4f412da39a01\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") "
Sep 06 10:50:48.301917 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.301681    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-workload-socket\") pod \"6c9472bf-075b-4340-a149-4f412da39a01\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") "
Sep 06 10:50:48.301917 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.301720    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c9472bf-075b-4340-a149-4f412da39a01-istio-podinfo\") pod \"6c9472bf-075b-4340-a149-4f412da39a01\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") "
Sep 06 10:50:48.301917 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.301785    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c9472bf-075b-4340-a149-4f412da39a01-istiod-ca-cert\") pod \"6c9472bf-075b-4340-a149-4f412da39a01\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") "
Sep 06 10:50:48.301917 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.301826    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-istio-envoy\") pod \"6c9472bf-075b-4340-a149-4f412da39a01\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") "
Sep 06 10:50:48.301917 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.301852    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-credential-socket\") pod \"6c9472bf-075b-4340-a149-4f412da39a01\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") "
Sep 06 10:50:48.301917 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.301880    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znkxk\" (UniqueName: \"kubernetes.io/projected/6c9472bf-075b-4340-a149-4f412da39a01-kube-api-access-znkxk\") pod \"6c9472bf-075b-4340-a149-4f412da39a01\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") "
Sep 06 10:50:48.301917 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.301916    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-istio-data\") pod \"6c9472bf-075b-4340-a149-4f412da39a01\" (UID: \"6c9472bf-075b-4340-a149-4f412da39a01\") "
Sep 06 10:50:48.302314 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.302008    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c9472bf-075b-4340-a149-4f412da39a01" (UID: "6c9472bf-075b-4340-a149-4f412da39a01"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:50:48.302314 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.302050    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c9472bf-075b-4340-a149-4f412da39a01" (UID: "6c9472bf-075b-4340-a149-4f412da39a01"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:50:48.302314 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.302202    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c9472bf-075b-4340-a149-4f412da39a01" (UID: "6c9472bf-075b-4340-a149-4f412da39a01"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:50:48.302314 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.302265    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c9472bf-075b-4340-a149-4f412da39a01" (UID: "6c9472bf-075b-4340-a149-4f412da39a01"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:50:48.302314 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.302265    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c9472bf-075b-4340-a149-4f412da39a01-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c9472bf-075b-4340-a149-4f412da39a01" (UID: "6c9472bf-075b-4340-a149-4f412da39a01"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 10:50:48.302634 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.302399    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-workload-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:48.302634 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.302425    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-workload-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:48.302634 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.302441    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-credential-socket\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:48.304040 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.304004    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c9472bf-075b-4340-a149-4f412da39a01-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c9472bf-075b-4340-a149-4f412da39a01" (UID: "6c9472bf-075b-4340-a149-4f412da39a01"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 10:50:48.304176 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.304074    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c9472bf-075b-4340-a149-4f412da39a01-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c9472bf-075b-4340-a149-4f412da39a01" (UID: "6c9472bf-075b-4340-a149-4f412da39a01"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:50:48.304483 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.304455    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c9472bf-075b-4340-a149-4f412da39a01" (UID: "6c9472bf-075b-4340-a149-4f412da39a01"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 10:50:48.304483 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.304469    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c9472bf-075b-4340-a149-4f412da39a01-kube-api-access-znkxk" (OuterVolumeSpecName: "kube-api-access-znkxk") pod "6c9472bf-075b-4340-a149-4f412da39a01" (UID: "6c9472bf-075b-4340-a149-4f412da39a01"). InnerVolumeSpecName "kube-api-access-znkxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 10:50:48.403047 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.402975    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c9472bf-075b-4340-a149-4f412da39a01-istio-token\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:48.403047 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.402996    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c9472bf-075b-4340-a149-4f412da39a01-istio-podinfo\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:48.403047 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.403005    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c9472bf-075b-4340-a149-4f412da39a01-istiod-ca-cert\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:48.403047 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.403013    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-istio-envoy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:48.403047 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.403023    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znkxk\" (UniqueName: \"kubernetes.io/projected/6c9472bf-075b-4340-a149-4f412da39a01-kube-api-access-znkxk\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:48.403047 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.403031    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c9472bf-075b-4340-a149-4f412da39a01-istio-data\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\""
Sep 06 10:50:48.949471 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.949437    2561 generic.go:356] "Generic (PLEG): container finished" podID="6c9472bf-075b-4340-a149-4f412da39a01" containerID="e5a1f71a1b2aedb954265888942e27a0228a3ef8b16782f52e5893b9176c56f3" exitCode=0
Sep 06 10:50:48.949947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.949486    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"
Sep 06 10:50:48.949947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.949520    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k" event={"ID":"6c9472bf-075b-4340-a149-4f412da39a01","Type":"ContainerDied","Data":"e5a1f71a1b2aedb954265888942e27a0228a3ef8b16782f52e5893b9176c56f3"}
Sep 06 10:50:48.949947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.949580    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k" event={"ID":"6c9472bf-075b-4340-a149-4f412da39a01","Type":"ContainerDied","Data":"f13d7bef4aca815730c1f6827cfb26f53eaceec12c01e5872e85328a3f1242ea"}
Sep 06 10:50:48.949947 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.949611    2561 scope.go:117] "RemoveContainer" containerID="e5a1f71a1b2aedb954265888942e27a0228a3ef8b16782f52e5893b9176c56f3"
Sep 06 10:50:48.959854 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.959836    2561 scope.go:117] "RemoveContainer" containerID="f4bd4533a859dc65f059ac0e44b04bf72b870fd24bcb15882bdb0e7ebc55f0e9"
Sep 06 10:50:48.967545 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.967521    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"]
Sep 06 10:50:48.968924 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.968907    2561 scope.go:117] "RemoveContainer" containerID="e5a1f71a1b2aedb954265888942e27a0228a3ef8b16782f52e5893b9176c56f3"
Sep 06 10:50:48.969234 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:50:48.969214    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5a1f71a1b2aedb954265888942e27a0228a3ef8b16782f52e5893b9176c56f3\": container with ID starting with e5a1f71a1b2aedb954265888942e27a0228a3ef8b16782f52e5893b9176c56f3 not found: ID does not exist" containerID="e5a1f71a1b2aedb954265888942e27a0228a3ef8b16782f52e5893b9176c56f3"
Sep 06 10:50:48.969295 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.969243    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5a1f71a1b2aedb954265888942e27a0228a3ef8b16782f52e5893b9176c56f3"} err="failed to get container status \"e5a1f71a1b2aedb954265888942e27a0228a3ef8b16782f52e5893b9176c56f3\": rpc error: code = NotFound desc = could not find container \"e5a1f71a1b2aedb954265888942e27a0228a3ef8b16782f52e5893b9176c56f3\": container with ID starting with e5a1f71a1b2aedb954265888942e27a0228a3ef8b16782f52e5893b9176c56f3 not found: ID does not exist"
Sep 06 10:50:48.969295 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.969261    2561 scope.go:117] "RemoveContainer" containerID="f4bd4533a859dc65f059ac0e44b04bf72b870fd24bcb15882bdb0e7ebc55f0e9"
Sep 06 10:50:48.969575 ip-10-0-137-121 kubenswrapper[2561]: E0906 10:50:48.969557    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4bd4533a859dc65f059ac0e44b04bf72b870fd24bcb15882bdb0e7ebc55f0e9\": container with ID starting with f4bd4533a859dc65f059ac0e44b04bf72b870fd24bcb15882bdb0e7ebc55f0e9 not found: ID does not exist" containerID="f4bd4533a859dc65f059ac0e44b04bf72b870fd24bcb15882bdb0e7ebc55f0e9"
Sep 06 10:50:48.969630 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.969583    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4bd4533a859dc65f059ac0e44b04bf72b870fd24bcb15882bdb0e7ebc55f0e9"} err="failed to get container status \"f4bd4533a859dc65f059ac0e44b04bf72b870fd24bcb15882bdb0e7ebc55f0e9\": rpc error: code = NotFound desc = could not find container \"f4bd4533a859dc65f059ac0e44b04bf72b870fd24bcb15882bdb0e7ebc55f0e9\": container with ID starting with f4bd4533a859dc65f059ac0e44b04bf72b870fd24bcb15882bdb0e7ebc55f0e9 not found: ID does not exist"
Sep 06 10:50:48.971389 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:48.971365    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-682ea0-openshift-default-7b6f9f94c4-zkg2k"]
Sep 06 10:50:49.254013 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:49.253981    2561 scope.go:117] "RemoveContainer" containerID="60ba10527f2be3375490b67f21b3e55c6c0b797d8f92b66b8c5db0331cfb7898"
Sep 06 10:50:49.271876 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:49.271842    2561 scope.go:117] "RemoveContainer" containerID="5329085b98b619a231768d0483cd4eee6acb11278ec8c35824f34b2dab6520cf"
Sep 06 10:50:49.281777 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:49.281757    2561 scope.go:117] "RemoveContainer" containerID="03f5af640af934b7e0dfb213ab3ce03e7574361fea53f683815b92a5623d5b71"
Sep 06 10:50:49.289443 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:49.289424    2561 scope.go:117] "RemoveContainer" containerID="1d2c856a08612b4f9aa1c039d0c9b0a28f9fce9a084f66ee959b5babb9bacdb2"
Sep 06 10:50:50.754024 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:50:50.753984    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c9472bf-075b-4340-a149-4f412da39a01" path="/var/lib/kubelet/pods/6c9472bf-075b-4340-a149-4f412da39a01/volumes"
Sep 06 10:51:48.883677 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:51:48.883651    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/1.log"
Sep 06 10:51:48.892533 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:51:48.892505    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsw6t_a4733769-37b3-443b-9ee5-d93bd5f167f0/ovn-acl-logging/0.log"
Sep 06 10:51:48.893845 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:51:48.893818    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/1.log"
Sep 06 10:51:48.898835 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:51:48.898816    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsw6t_a4733769-37b3-443b-9ee5-d93bd5f167f0/ovn-acl-logging/0.log"
Sep 06 10:51:49.341312 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:51:49.341280    2561 scope.go:117] "RemoveContainer" containerID="255ba0a6f53d55b245d5862b354813dda7730ebc2f92af9f65d024be371c9e6a"
Sep 06 10:51:49.350175 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:51:49.350158    2561 scope.go:117] "RemoveContainer" containerID="73c712c349d252190c2e9c2ed7c98bd902273a6f47ac4ec1d3a0b60357964bff"
Sep 06 10:51:49.357928 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:51:49.357901    2561 scope.go:117] "RemoveContainer" containerID="e16097bd0d5861e066883c41be61a7b685cbcc8265bd3367e22868f0b37b645d"
Sep 06 10:52:11.201289 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:52:11.201249    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:52:12.569710 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:52:12.569679    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:53:08.169971 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:53:08.169921    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:53:09.236088 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:53:09.236052    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:53:29.193281 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:53:29.193249    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:54:49.403568 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:54:49.403529    2561 scope.go:117] "RemoveContainer" containerID="876557295e57bce18867d297f2d5338d113a984b8f8d68b8a7447e669cfa7253"
Sep 06 10:54:49.412279 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:54:49.412261    2561 scope.go:117] "RemoveContainer" containerID="a5a60f1aaab1691bc7597ab1af1092ccaa0cb8bcba93a0526a8822c3c6b2b8cb"
Sep 06 10:55:11.651371 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:55:11.651315    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:55:19.615690 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:55:19.615652    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:55:44.275127 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:55:44.275092    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:55:45.179490 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:55:45.179459    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:56:35.799470 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:35.799377    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7scd5_3d6d17cc-95fa-4644-90f2-79dfda62db96/manager/0.log"
Sep 06 10:56:35.920294 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:35.920264    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jtfgl_754d046c-c778-49e0-b609-1f11e839568c/manager/0.log"
Sep 06 10:56:36.645597 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:36.645560    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c688cbfb6-x8v4w_18ff4b44-2447-4508-baca-b7558d62b48e/manager/0.log"
Sep 06 10:56:36.651240 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:36.651215    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c688cbfb6-x8v4w_18ff4b44-2447-4508-baca-b7558d62b48e/copy-manifests/0.log"
Sep 06 10:56:37.229683 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:37.229655    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29811525-5xgfl_608e5ada-ff04-4f82-91a1-40b242cf9b83/cleanup/0.log"
Sep 06 10:56:37.339156 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:37.339121    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-qsvmz_d659269b-568b-4713-8bc2-10f50642a01c/postgres/0.log"
Sep 06 10:56:38.243305 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:38.243270    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-j8nq4_ead5cd14-40cf-4099-b200-ad538f8967fb/manager/0.log"
Sep 06 10:56:38.353736 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:38.353699    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-c2d2c_9a62864d-9500-4b86-8c17-1912e1b096e4/manager/0.log"
Sep 06 10:56:39.194082 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:39.194051    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd_b57be4b3-f641-48d6-990d-302fe3fe9c0f/istio-proxy/0.log"
Sep 06 10:56:39.655430 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:39.655392    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-426bc_60de9283-9f89-4fdc-9874-73ea1fb3d134/istio-proxy/1.log"
Sep 06 10:56:39.908964 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:39.908871    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-gsbqz_da70f3cc-515f-40f9-83fe-ac247b59d6c2/payload-processing/0.log"
Sep 06 10:56:40.043429 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:40.043395    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66bc586b4-fkkkm_1056410a-6c66-44ab-b62e-8e2046b73703/router/0.log"
Sep 06 10:56:40.629887 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:40.629854    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-hptkp_1e30156f-eb5e-425d-9753-6bbee1deeead/main/0.log"
Sep 06 10:56:40.848489 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:40.848455    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f2fl6h_853f7558-e474-4eb0-811e-95a5159296e6/main/0.log"
Sep 06 10:56:46.344069 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.344036    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qdn88/must-gather-g48nz"]
Sep 06 10:56:46.344519 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.344486    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c9472bf-075b-4340-a149-4f412da39a01" containerName="istio-proxy"
Sep 06 10:56:46.344519 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.344501    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c9472bf-075b-4340-a149-4f412da39a01" containerName="istio-proxy"
Sep 06 10:56:46.344519 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.344509    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c9472bf-075b-4340-a149-4f412da39a01" containerName="istio-proxy"
Sep 06 10:56:46.344519 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.344516    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c9472bf-075b-4340-a149-4f412da39a01" containerName="istio-proxy"
Sep 06 10:56:46.344664 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.344526    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eafa52ae-6ca8-4303-911d-9b15f11b78f4" containerName="istio-proxy"
Sep 06 10:56:46.344664 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.344535    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="eafa52ae-6ca8-4303-911d-9b15f11b78f4" containerName="istio-proxy"
Sep 06 10:56:46.344664 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.344543    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d53382ce-5c5e-4e14-8cbc-01a0339e489b" containerName="revoke-keys"
Sep 06 10:56:46.344664 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.344550    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d53382ce-5c5e-4e14-8cbc-01a0339e489b" containerName="revoke-keys"
Sep 06 10:56:46.344664 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.344638    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="eafa52ae-6ca8-4303-911d-9b15f11b78f4" containerName="istio-proxy"
Sep 06 10:56:46.344664 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.344648    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c9472bf-075b-4340-a149-4f412da39a01" containerName="istio-proxy"
Sep 06 10:56:46.344664 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.344655    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c9472bf-075b-4340-a149-4f412da39a01" containerName="istio-proxy"
Sep 06 10:56:46.344664 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.344663    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d53382ce-5c5e-4e14-8cbc-01a0339e489b" containerName="revoke-keys"
Sep 06 10:56:46.344908 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.344668    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="eafa52ae-6ca8-4303-911d-9b15f11b78f4" containerName="istio-proxy"
Sep 06 10:56:46.344908 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.344770    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eafa52ae-6ca8-4303-911d-9b15f11b78f4" containerName="istio-proxy"
Sep 06 10:56:46.344908 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.344779    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="eafa52ae-6ca8-4303-911d-9b15f11b78f4" containerName="istio-proxy"
Sep 06 10:56:46.346505 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.346470    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:56:46.348122 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.348100    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qdn88/must-gather-g48nz"
Sep 06 10:56:46.350514 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.350495    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qdn88\"/\"kube-root-ca.crt\""
Sep 06 10:56:46.351246 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.351225    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qdn88\"/\"openshift-service-ca.crt\""
Sep 06 10:56:46.351389 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.351301    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qdn88\"/\"default-dockercfg-lbxvv\""
Sep 06 10:56:46.357347 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.357294    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qdn88/must-gather-g48nz"]
Sep 06 10:56:46.441713 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.441676    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69jdk\" (UniqueName: \"kubernetes.io/projected/c371394f-b19b-4cfb-ad6f-704963955b33-kube-api-access-69jdk\") pod \"must-gather-g48nz\" (UID: \"c371394f-b19b-4cfb-ad6f-704963955b33\") " pod="openshift-must-gather-qdn88/must-gather-g48nz"
Sep 06 10:56:46.441713 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.441717    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c371394f-b19b-4cfb-ad6f-704963955b33-must-gather-output\") pod \"must-gather-g48nz\" (UID: \"c371394f-b19b-4cfb-ad6f-704963955b33\") " pod="openshift-must-gather-qdn88/must-gather-g48nz"
Sep 06 10:56:46.446058 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.446022    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log" limit=1024
Sep 06 10:56:46.542951 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.542904    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69jdk\" (UniqueName: \"kubernetes.io/projected/c371394f-b19b-4cfb-ad6f-704963955b33-kube-api-access-69jdk\") pod \"must-gather-g48nz\" (UID: \"c371394f-b19b-4cfb-ad6f-704963955b33\") " pod="openshift-must-gather-qdn88/must-gather-g48nz"
Sep 06 10:56:46.542951 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.542959    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c371394f-b19b-4cfb-ad6f-704963955b33-must-gather-output\") pod \"must-gather-g48nz\" (UID: \"c371394f-b19b-4cfb-ad6f-704963955b33\") " pod="openshift-must-gather-qdn88/must-gather-g48nz"
Sep 06 10:56:46.543341 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.543301    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c371394f-b19b-4cfb-ad6f-704963955b33-must-gather-output\") pod \"must-gather-g48nz\" (UID: \"c371394f-b19b-4cfb-ad6f-704963955b33\") " pod="openshift-must-gather-qdn88/must-gather-g48nz"
Sep 06 10:56:46.554028 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.554002    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69jdk\" (UniqueName: \"kubernetes.io/projected/c371394f-b19b-4cfb-ad6f-704963955b33-kube-api-access-69jdk\") pod \"must-gather-g48nz\" (UID: \"c371394f-b19b-4cfb-ad6f-704963955b33\") " pod="openshift-must-gather-qdn88/must-gather-g48nz"
Sep 06 10:56:46.659399 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.659373    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qdn88/must-gather-g48nz"
Sep 06 10:56:46.929310 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.929277    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qdn88/must-gather-g48nz"]
Sep 06 10:56:46.930983 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:56:46.930960    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc371394f_b19b_4cfb_ad6f_704963955b33.slice/crio-b946b2ad99d2c481f89032c7f33e53bbd672b53eb8ff4bc9a526d77585055617 WatchSource:0}: Error finding container b946b2ad99d2c481f89032c7f33e53bbd672b53eb8ff4bc9a526d77585055617: Status 404 returned error can't find the container with id b946b2ad99d2c481f89032c7f33e53bbd672b53eb8ff4bc9a526d77585055617
Sep 06 10:56:46.933268 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:46.933250    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 10:56:47.058528 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:47.058494    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qdn88/must-gather-g48nz" event={"ID":"c371394f-b19b-4cfb-ad6f-704963955b33","Type":"ContainerStarted","Data":"b946b2ad99d2c481f89032c7f33e53bbd672b53eb8ff4bc9a526d77585055617"}
Sep 06 10:56:48.067802 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:48.067060    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qdn88/must-gather-g48nz" event={"ID":"c371394f-b19b-4cfb-ad6f-704963955b33","Type":"ContainerStarted","Data":"39141e82f094673fd1e5bca6be828dad1e735ca80d050cccd8d1a87d0bb41498"}
Sep 06 10:56:48.067802 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:48.067119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qdn88/must-gather-g48nz" event={"ID":"c371394f-b19b-4cfb-ad6f-704963955b33","Type":"ContainerStarted","Data":"6571ca705f214cb7e9d492aade3e0fc2e4cab636978afc3471eaad6cb8e60f11"}
Sep 06 10:56:48.940800 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:48.940772    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/1.log"
Sep 06 10:56:48.944934 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:48.944908    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/1.log"
Sep 06 10:56:48.946258 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:48.946235    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsw6t_a4733769-37b3-443b-9ee5-d93bd5f167f0/ovn-acl-logging/0.log"
Sep 06 10:56:48.950429 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:48.950413    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bsw6t_a4733769-37b3-443b-9ee5-d93bd5f167f0/ovn-acl-logging/0.log"
Sep 06 10:56:49.376441 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:49.376360    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nkc66_4ff152b4-4c19-4c64-af60-41eeb9cbb81e/global-pull-secret-syncer/0.log"
Sep 06 10:56:49.432114 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:49.432076    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fnht9_f4268319-f028-4865-857a-4b453a4c42fd/konnectivity-agent/0.log"
Sep 06 10:56:49.445210 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:49.445171    2561 scope.go:117] "RemoveContainer" containerID="74c675634613b23a55f437908f0a706e2ad38d7dcc9da2943f676aba278d865d"
Sep 06 10:56:49.456690 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:49.456669    2561 scope.go:117] "RemoveContainer" containerID="55cad7a241001cb64162d933149a6521927c8ee5bb8dfbbbb3f79971c102d883"
Sep 06 10:56:49.466176 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:49.466153    2561 scope.go:117] "RemoveContainer" containerID="f3e2a18d13052ec336c06b965ed6262add2bf90f21063c7581961b58956d4847"
Sep 06 10:56:49.549501 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:49.549461    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-121.ec2.internal_9dd0ee06e29e903dab72058d7f78cdf8/haproxy/0.log"
Sep 06 10:56:54.643511 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:54.643474    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-j8nq4_ead5cd14-40cf-4099-b200-ad538f8967fb/manager/0.log"
Sep 06 10:56:54.665404 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:54.665371    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-c2d2c_9a62864d-9500-4b86-8c17-1912e1b096e4/manager/0.log"
Sep 06 10:56:56.181132 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:56.181100    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb395480-ff5e-4361-9b72-4eca310e1099/alertmanager/0.log"
Sep 06 10:56:56.203980 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:56.203946    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb395480-ff5e-4361-9b72-4eca310e1099/config-reloader/0.log"
Sep 06 10:56:56.225654 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:56.225604    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb395480-ff5e-4361-9b72-4eca310e1099/kube-rbac-proxy-web/0.log"
Sep 06 10:56:56.244759 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:56.244726    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb395480-ff5e-4361-9b72-4eca310e1099/kube-rbac-proxy/0.log"
Sep 06 10:56:56.264839 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:56.264805    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb395480-ff5e-4361-9b72-4eca310e1099/kube-rbac-proxy-metric/0.log"
Sep 06 10:56:56.288517 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:56.288473    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb395480-ff5e-4361-9b72-4eca310e1099/prom-label-proxy/0.log"
Sep 06 10:56:56.304047 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:56.304015    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb395480-ff5e-4361-9b72-4eca310e1099/init-config-reloader/0.log"
Sep 06 10:56:56.371355 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:56.370966    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-jpxdn_5a7404c4-4386-4f2d-aa64-ea0622b6d073/cluster-monitoring-operator/0.log"
Sep 06 10:56:56.747632 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:56.747588    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z6v4s_0195966b-d760-40b3-8952-25fb4edbea0f/node-exporter/0.log"
Sep 06 10:56:56.768928 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:56.768848    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z6v4s_0195966b-d760-40b3-8952-25fb4edbea0f/kube-rbac-proxy/0.log"
Sep 06 10:56:56.790026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:56.789993    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z6v4s_0195966b-d760-40b3-8952-25fb4edbea0f/init-textfile/0.log"
Sep 06 10:56:57.254014 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:57.253985    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-799d47dff5-c7hmg_9c213b88-a001-45d0-b9c4-d92b590a730a/telemeter-client/0.log"
Sep 06 10:56:57.276171 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:57.276139    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-799d47dff5-c7hmg_9c213b88-a001-45d0-b9c4-d92b590a730a/reload/0.log"
Sep 06 10:56:57.299421 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:57.299386    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-799d47dff5-c7hmg_9c213b88-a001-45d0-b9c4-d92b590a730a/kube-rbac-proxy/0.log"
Sep 06 10:56:58.789442 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:58.789398    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-8ljwg_4bd4b7d8-718f-4d1d-95b8-87e0d2a0f822/networking-console-plugin/0.log"
Sep 06 10:56:59.349459 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.349390    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qdn88/must-gather-g48nz" podStartSLOduration=12.544248154 podStartE2EDuration="13.349367336s" totalImagesPullingTime="805.119182ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 10:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:56:48.083117982 +0000 UTC m=+2099.861537397" watchObservedRunningTime="2026-09-06 10:56:59.349367336 +0000 UTC m=+2111.127786753"
Sep 06 10:56:59.352455 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.352422    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"]
Sep 06 10:56:59.359102 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.359053    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"
Sep 06 10:56:59.364436 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.364413    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"]
Sep 06 10:56:59.377815 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.377786    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/1.log"
Sep 06 10:56:59.388144 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.388063    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-fgtkf_dfee3641-093e-47c4-bb89-51a039ac335c/console-operator/2.log"
Sep 06 10:56:59.485102 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.485053    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wcs6\" (UniqueName: \"kubernetes.io/projected/c3a5e488-eab8-4992-b43e-ebe393ceb3d1-kube-api-access-4wcs6\") pod \"perf-node-gather-daemonset-ckrr4\" (UID: \"c3a5e488-eab8-4992-b43e-ebe393ceb3d1\") " pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"
Sep 06 10:56:59.485421 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.485386    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3a5e488-eab8-4992-b43e-ebe393ceb3d1-lib-modules\") pod \"perf-node-gather-daemonset-ckrr4\" (UID: \"c3a5e488-eab8-4992-b43e-ebe393ceb3d1\") " pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"
Sep 06 10:56:59.485636 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.485620    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3a5e488-eab8-4992-b43e-ebe393ceb3d1-podres\") pod \"perf-node-gather-daemonset-ckrr4\" (UID: \"c3a5e488-eab8-4992-b43e-ebe393ceb3d1\") " pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"
Sep 06 10:56:59.485820 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.485791    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3a5e488-eab8-4992-b43e-ebe393ceb3d1-proc\") pod \"perf-node-gather-daemonset-ckrr4\" (UID: \"c3a5e488-eab8-4992-b43e-ebe393ceb3d1\") " pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"
Sep 06 10:56:59.486022 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.486006    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3a5e488-eab8-4992-b43e-ebe393ceb3d1-sys\") pod \"perf-node-gather-daemonset-ckrr4\" (UID: \"c3a5e488-eab8-4992-b43e-ebe393ceb3d1\") " pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"
Sep 06 10:56:59.587073 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.587039    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3a5e488-eab8-4992-b43e-ebe393ceb3d1-proc\") pod \"perf-node-gather-daemonset-ckrr4\" (UID: \"c3a5e488-eab8-4992-b43e-ebe393ceb3d1\") " pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"
Sep 06 10:56:59.587266 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.587083    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3a5e488-eab8-4992-b43e-ebe393ceb3d1-sys\") pod \"perf-node-gather-daemonset-ckrr4\" (UID: \"c3a5e488-eab8-4992-b43e-ebe393ceb3d1\") " pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"
Sep 06 10:56:59.587266 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.587151    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wcs6\" (UniqueName: \"kubernetes.io/projected/c3a5e488-eab8-4992-b43e-ebe393ceb3d1-kube-api-access-4wcs6\") pod \"perf-node-gather-daemonset-ckrr4\" (UID: \"c3a5e488-eab8-4992-b43e-ebe393ceb3d1\") " pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"
Sep 06 10:56:59.587266 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.587172    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c3a5e488-eab8-4992-b43e-ebe393ceb3d1-proc\") pod \"perf-node-gather-daemonset-ckrr4\" (UID: \"c3a5e488-eab8-4992-b43e-ebe393ceb3d1\") " pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"
Sep 06 10:56:59.587266 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.587198    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3a5e488-eab8-4992-b43e-ebe393ceb3d1-lib-modules\") pod \"perf-node-gather-daemonset-ckrr4\" (UID: \"c3a5e488-eab8-4992-b43e-ebe393ceb3d1\") " pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"
Sep 06 10:56:59.587266 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.587212    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3a5e488-eab8-4992-b43e-ebe393ceb3d1-sys\") pod \"perf-node-gather-daemonset-ckrr4\" (UID: \"c3a5e488-eab8-4992-b43e-ebe393ceb3d1\") " pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"
Sep 06 10:56:59.587513 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.587277    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3a5e488-eab8-4992-b43e-ebe393ceb3d1-podres\") pod \"perf-node-gather-daemonset-ckrr4\" (UID: \"c3a5e488-eab8-4992-b43e-ebe393ceb3d1\") " pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"
Sep 06 10:56:59.587513 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.587368    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3a5e488-eab8-4992-b43e-ebe393ceb3d1-lib-modules\") pod \"perf-node-gather-daemonset-ckrr4\" (UID: \"c3a5e488-eab8-4992-b43e-ebe393ceb3d1\") " pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"
Sep 06 10:56:59.587513 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.587462    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c3a5e488-eab8-4992-b43e-ebe393ceb3d1-podres\") pod \"perf-node-gather-daemonset-ckrr4\" (UID: \"c3a5e488-eab8-4992-b43e-ebe393ceb3d1\") " pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"
Sep 06 10:56:59.595691 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.595659    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wcs6\" (UniqueName: \"kubernetes.io/projected/c3a5e488-eab8-4992-b43e-ebe393ceb3d1-kube-api-access-4wcs6\") pod \"perf-node-gather-daemonset-ckrr4\" (UID: \"c3a5e488-eab8-4992-b43e-ebe393ceb3d1\") " pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"
Sep 06 10:56:59.675760 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.675702    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"
Sep 06 10:56:59.937028 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.936909    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-dc7d7c8cd-92m2v_e5ee379c-5488-4e20-93bd-e8523e91534c/console/0.log"
Sep 06 10:56:59.968277 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:56:59.968248    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"]
Sep 06 10:56:59.971042 ip-10-0-137-121 kubenswrapper[2561]: W0906 10:56:59.970996    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc3a5e488_eab8_4992_b43e_ebe393ceb3d1.slice/crio-cb10170924eab97b90a8f4bb1823e38f4482461956fba963e18dd3fb782a5a31 WatchSource:0}: Error finding container cb10170924eab97b90a8f4bb1823e38f4482461956fba963e18dd3fb782a5a31: Status 404 returned error can't find the container with id cb10170924eab97b90a8f4bb1823e38f4482461956fba963e18dd3fb782a5a31
Sep 06 10:57:00.170177 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:00.170136    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4" event={"ID":"c3a5e488-eab8-4992-b43e-ebe393ceb3d1","Type":"ContainerStarted","Data":"2093bc4c136dd5d3659e47311b5a4234ccac9afa469659aca77260616936c156"}
Sep 06 10:57:00.170775 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:00.170212    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"
Sep 06 10:57:00.170895 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:00.170812    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4" event={"ID":"c3a5e488-eab8-4992-b43e-ebe393ceb3d1","Type":"ContainerStarted","Data":"cb10170924eab97b90a8f4bb1823e38f4482461956fba963e18dd3fb782a5a31"}
Sep 06 10:57:00.187974 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:00.187886    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4" podStartSLOduration=1.187870768 podStartE2EDuration="1.187870768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 10:56:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 10:57:00.185139953 +0000 UTC m=+2111.963559367" watchObservedRunningTime="2026-09-06 10:57:00.187870768 +0000 UTC m=+2111.966290181"
Sep 06 10:57:00.657199 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:00.657169    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-7px8b_dbf09546-a6d3-4b10-900a-0940b9c2794e/volume-data-source-validator/0.log"
Sep 06 10:57:01.772806 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:01.772774    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zzn8f_f9689b0e-8830-4c94-befb-3c64ef549feb/dns/0.log"
Sep 06 10:57:01.793367 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:01.793312    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zzn8f_f9689b0e-8830-4c94-befb-3c64ef549feb/kube-rbac-proxy/0.log"
Sep 06 10:57:01.864006 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:01.863968    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mtfnz_3e728c52-da89-4425-b478-c21e3eea361a/dns-node-resolver/0.log"
Sep 06 10:57:02.473355 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:02.473297    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zr4w8_4e601580-f2cf-423c-bf46-337104486a51/node-ca/0.log"
Sep 06 10:57:03.431960 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:03.431925    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd_b57be4b3-f641-48d6-990d-302fe3fe9c0f/istio-proxy/0.log"
Sep 06 10:57:03.782901 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:03.782814    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-426bc_60de9283-9f89-4fdc-9874-73ea1fb3d134/istio-proxy/0.log"
Sep 06 10:57:03.802959 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:03.802925    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-426bc_60de9283-9f89-4fdc-9874-73ea1fb3d134/istio-proxy/1.log"
Sep 06 10:57:03.886245 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:03.886196    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-gsbqz_da70f3cc-515f-40f9-83fe-ac247b59d6c2/payload-processing/0.log"
Sep 06 10:57:03.912345 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:03.912288    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66bc586b4-fkkkm_1056410a-6c66-44ab-b62e-8e2046b73703/router/0.log"
Sep 06 10:57:04.775942 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:04.775909    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h5mgn_30979a9f-a090-4ced-a423-0f091a73a801/serve-healthcheck-canary/0.log"
Sep 06 10:57:05.270800 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:05.270760    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-cs9gt_c3c63327-812e-4353-903f-2ad8d3a5b31f/insights-operator/0.log"
Sep 06 10:57:05.271108 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:05.271087    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-cs9gt_c3c63327-812e-4353-903f-2ad8d3a5b31f/insights-operator/1.log"
Sep 06 10:57:05.414642 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:05.414612    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nt7q7_db9a6bc0-79fe-4914-bee3-adc09cdcd439/kube-rbac-proxy/0.log"
Sep 06 10:57:05.433026 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:05.432980    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nt7q7_db9a6bc0-79fe-4914-bee3-adc09cdcd439/exporter/0.log"
Sep 06 10:57:05.452317 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:05.452288    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nt7q7_db9a6bc0-79fe-4914-bee3-adc09cdcd439/extractor/0.log"
Sep 06 10:57:06.188739 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:06.188709    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qdn88/perf-node-gather-daemonset-ckrr4"
Sep 06 10:57:07.569620 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:07.569558    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7scd5_3d6d17cc-95fa-4644-90f2-79dfda62db96/manager/0.log"
Sep 06 10:57:07.903655 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:07.903392    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jtfgl_754d046c-c778-49e0-b609-1f11e839568c/manager/0.log"
Sep 06 10:57:08.257986 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:08.257937    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c688cbfb6-x8v4w_18ff4b44-2447-4508-baca-b7558d62b48e/manager/0.log"
Sep 06 10:57:08.275456 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:08.275317    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c688cbfb6-x8v4w_18ff4b44-2447-4508-baca-b7558d62b48e/copy-manifests/0.log"
Sep 06 10:57:09.703812 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:09.703777    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5dc6f584c9-z859z_1d3c6039-9437-4ffe-bd6b-aec7d5d9c37e/manager/0.log"
Sep 06 10:57:10.260182 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:10.260148    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd_b57be4b3-f641-48d6-990d-302fe3fe9c0f/istio-proxy/0.log"
Sep 06 10:57:10.588656 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:10.588565    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-426bc_60de9283-9f89-4fdc-9874-73ea1fb3d134/istio-proxy/0.log"
Sep 06 10:57:10.600183 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:10.598659    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-426bc_60de9283-9f89-4fdc-9874-73ea1fb3d134/istio-proxy/1.log"
Sep 06 10:57:10.663538 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:10.663511    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-gsbqz_da70f3cc-515f-40f9-83fe-ac247b59d6c2/payload-processing/0.log"
Sep 06 10:57:10.679416 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:10.679385    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66bc586b4-fkkkm_1056410a-6c66-44ab-b62e-8e2046b73703/router/0.log"
Sep 06 10:57:12.123948 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:12.123912    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-shrnd_b57be4b3-f641-48d6-990d-302fe3fe9c0f/istio-proxy/0.log"
Sep 06 10:57:12.464542 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:12.464506    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-426bc_60de9283-9f89-4fdc-9874-73ea1fb3d134/istio-proxy/0.log"
Sep 06 10:57:12.476985 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:12.476950    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-426bc_60de9283-9f89-4fdc-9874-73ea1fb3d134/istio-proxy/1.log"
Sep 06 10:57:12.548850 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:12.548800    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-gsbqz_da70f3cc-515f-40f9-83fe-ac247b59d6c2/payload-processing/0.log"
Sep 06 10:57:12.565150 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:12.565117    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66bc586b4-fkkkm_1056410a-6c66-44ab-b62e-8e2046b73703/router/0.log"
Sep 06 10:57:15.021719 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:15.021689    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-fcskx_e20c6a2b-e419-4124-884a-b60dac26955d/kube-storage-version-migrator-operator/1.log"
Sep 06 10:57:15.023623 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:15.023590    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-fcskx_e20c6a2b-e419-4124-884a-b60dac26955d/kube-storage-version-migrator-operator/0.log"
Sep 06 10:57:16.068566 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:16.068531    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5pbf6_e0afff6f-56fa-47c8-81ed-e519bde388ba/kube-multus/0.log"
Sep 06 10:57:16.542150 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:16.542120    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6wfp_1fec0b65-b25f-4f26-9dd5-facb730de5a8/kube-multus-additional-cni-plugins/0.log"
Sep 06 10:57:16.562067 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:16.562026    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6wfp_1fec0b65-b25f-4f26-9dd5-facb730de5a8/egress-router-binary-copy/0.log"
Sep 06 10:57:16.581770 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:16.581730    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6wfp_1fec0b65-b25f-4f26-9dd5-facb730de5a8/cni-plugins/0.log"
Sep 06 10:57:16.602561 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:16.602522    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6wfp_1fec0b65-b25f-4f26-9dd5-facb730de5a8/bond-cni-plugin/0.log"
Sep 06 10:57:16.623266 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:16.623231    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6wfp_1fec0b65-b25f-4f26-9dd5-facb730de5a8/routeoverride-cni/0.log"
Sep 06 10:57:16.644193 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:16.644156    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6wfp_1fec0b65-b25f-4f26-9dd5-facb730de5a8/whereabouts-cni-bincopy/0.log"
Sep 06 10:57:16.671131 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:16.671102    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h6wfp_1fec0b65-b25f-4f26-9dd5-facb730de5a8/whereabouts-cni/0.log"
Sep 06 10:57:16.743448 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:16.743418    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6prgq_705da257-7931-44ef-89b4-070ba34f4cb0/network-metrics-daemon/0.log"
Sep 06 10:57:16.767684 ip-10-0-137-121 kubenswrapper[2561]: I0906 10:57:16.767650    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6prgq_705da257-7931-44ef-89b4-070ba34f4cb0/kube-rbac-proxy/0.log"